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Abstract 

The  Air  Force  Research  Laboratory  (AFRL)  Sensors  Directorate  has  constructed 
and  tested  a  coherent  Light  Detection  And  Ranging  (LIDAR)  imaging  system  called 
Laservision.  Registration  of  individual  images  remains  a  significant  problem  in  the 
generation  of  useful  images  collected  using  coherent  imaging  systems. 

Coherent  images  typically  contain  significant  speckle  noise  created  by  the  co¬ 
herent  nature  of  the  laser.  Each  image  collected  by  the  system  must  be  properly 
registered  to  allow  for  averaging  the  images  to  produce  a  single  image  with  adequate 
resolution  to  allow  detection  and  identification  algorithms  to  operate  accurately  or 
for  system  operators  to  perform  target  detection  and  identification  within  a  scene. 

An  investigation  of  the  performance  of  a  new  image  registration  algorithm  de¬ 
signed  using  laser  speckle  noise  statistics  is  conducted  on  data  collected  from  the 
Laservision  system.  This  thesis  documents  the  design  and  performance  of  the  pro¬ 
posed  technique  compared  to  that  of  a  standard  cross-correlation  algorithm. 

Based  on  using  only  speckle  noise  statistics,  the  simulated  data  test  results 
indicate  that  there  is  a  small  range  of  low  average  signal-to-noise  ratios  (SNR)  where 
there  is  the  potential  to  improve  the  shift  estimation  error  by  0.1  to  0.16  pixels. 
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DEVELOPMENT  OF  A  ROBUST  OPTICAL  IMAGE 


REGISTRATION  ALGORITHM  FOR  NEGATING 
SPECKLE  NOISE  EFFECTS  IN  COHERENT  IMAGES 
GENERATED  BY  A  LASER  IMAGING  SYSTEM 

I.  Introduction 

This  thesis  describes  the  development  of  a  robust  optical  image  registration  al¬ 
gorithm  for  negating  speckle  noise  effects  in  coherent  images  generated  by  a 
laser  imaging  system.  Current  registration  algorithms  are  analyzed  based  on  perfor¬ 
mance  metrics  as  applied  in  a  Light  Detection  And  Ranging  (LIDAR)  or  laser  radar 
(LADAR)  imaging  system,  and  a  new  algorithm  is  designed  specifically  for  LADAR 
image  registration.  Research  and  analysis  is  conducted  on  image  data  and  image 
registration  algorithms  are  implemented  in  Matlab®,  with  the  goal  of  developing  a 
registration  strategy  superior  to  that  currently  used  in  the  Air  Force  Research  Labo¬ 
ratory  (AFRL)  Laservision  system.  This  image  registration  research  also  serves  as  an 
enabling  technology  for  the  Defense  Advance  Research  Programs  Agency  (DARPA) 
Standoff  Precision  ID  in  3-D  (SPI-3D)  program. 

This  chapter  outlines  the  problem  statement,  illustrates  the  benefit  of  properly 
registering  images,  and  concludes  with  the  methodology  and  development  behind  the 
thesis. 


1.1  Problem  Statement 

Coherent  images  generated  by  LADAR  imaging  systems  typically  contain  high 
levels  of  speckle  noise  created  by  the  “coherent  nature  of  the  collected  energy”  of  the 
laser  beam  [5].  Coherent  images  are  those  where  the  phase  components  of  the  laser 
light  reflections  remain  relatively  constant,  or  retain  a  definite  relationship,  while  the 
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image  is  being  captured  by  the  system.  A  detailed  explanation  of  the  phenomenon  of 
speckle  noise  is  provided  in  Chapter  II. 

Each  image  collected  by  the  system  must  be  properly  registered  to  a  baseline 
image  before  a  set  of  images  can  be  averaged.  Averaging  serves  to  suppress  the  speckle 
noise  and  produce  a  single  image  with  adequate  resolution  to  allow  detection  and  iden¬ 
tification  algorithms  to  operate  accurately  or  for  system  operators  to  perform  target 
detection  and  identification  within  a  scene.  Additionally,  atmospheric  turbulence  and 
illuminator  motion  generate  a  spatial  shift  in  each  image  which  further  complicates 
the  registration  process.  The  current  registration  algorithm  used  in  the  Laservision 
system  could  be  improved  to  yield  better  imaging  performance. 

Alternative  registration  algorithms  currently  available  either  do  not  perform 
well  within  a  laser  imaging  environment,  are  too  computer  resource  intensive  for  the 
Laservision  imaging  system,  or  commonly  assume  a  normal  (Gaussian)  noise  distri¬ 
bution  in  estimating  the  motion  parameters  for  the  registration  algorithm,  which 
contributes  to  lower  performance.  The  Gaussian  noise  assumption,  while  frequently 
used  as  a  safe  representation  when  a  distribution  is  not  known,  does  not  characterize 
the  effects  of  coherent  image  speckle  noise  on  the  observed  image  and  therefore  is 
not  the  best  estimate  for  the  motion  parameters  used  in  the  registration  algorithm. 
Hence,  while  there  is  some  image  resolution  improvement  using  current  registration 
algorithms,  a  new  algorithm  designed  using  a  better  characterization  of  the  speckle 
noise  effect  on  the  observation  distribution  is  a  potential  solution  for  image  regis¬ 
tration  within  a  LADAR  system.  Based  on  Goodman’s  research  of  photon  count 
statistics  for  polarized  thermal  light  and  an  arbitrary  counting  interval,  the  observed 
distribution  is  known  as  a  negative  binomial  distribution  [4],  This  research  effort  de¬ 
velops  a  new  registration  estimation  algorithm  using  a  negative  binomial  realization 
of  the  noise. 
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Figure  1.1:  Speckle  Noise  Illustration.  Unprocessed  image 
from  the  AFRL  Laservision  system  highlighting  the  speckle  noise 
evident  in  individual  images  (i.e. ,  “graininess”  or  “fuzziness”). 

1.2  Benefit  of  Proper  Registration 

Referring  to  Figures  1.1,  1.2,  1.3,  the  obvious  benefit  of  properly  registering  a 
set  of  images  can  be  seen.  Figure  1.1  represents  an  unprocessed  image  from  the  AFRL 
Laservision  system  that  highlights  the  speckle  noise  evident  in  individual  images  (i.e., 
“graininess”  or  “fuzziness”).  Figures  1.2  and  1.3  illustrate  the  effects  of  averaging 
10  frames  of  data  without  registration  and  with  registration,  respectively.  Note  in 
Figure  1.2  that  the  averaging  process  suppresses  some  of  the  speckle  noise,  but  the 
lack  of  registration,  or  aligning  the  images,  severely  blurs  the  image.  However,  Fig¬ 
ure  1.3  demonstrates  the  power  of  registration  coupled  with  the  averaging  process, 
which  drastically  suppresses  the  speckle  noise  effect,  thus  creating  a  much  clearer  im¬ 
age  for  further  processing.  It  is  important  to  note  that  the  laser  images  were  taken 
with  a  stationary  system  with  very  little  movement.  Hence,  the  majority  of  the  x 
and  y  (translational)  estimated  by  a  registration  algorithm  are  shift  errors  induced 
by  the  speckle  noise.  It  is  evident  that  a  significant  image  recognition  improvement  is 
obtained  with  the  averaging  process,  but  only  if  the  image  is  properly  registered  [5]. 
Therefore,  coherent  laser  imaging  systems  require  accurate  and  efficient  image  regis- 
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tration  algorithms  as  a  key  enabling  technology  to  meet  operator  target  recognition 
requirements  that  improve  time-critical-targeting  (TCT)  capabilities. 


Figure  1.2:  Temporal  Averaging  without  Registration 

Illustration.  This  figure  highlights  the  effects  of  averaging  10 
frames  of  data  without  registration  (or  image  alignment).  The 
speckle  noise  effect  is  suppressed  to  an  extent,  but  the  lack  of 
registration  causes  severe  blurring  of  the  image. 


Figure  1.3:  Registration  and  Temporal  Averaging  Il¬ 

lustration.  This  figure  highlights  the  effects  of  averaging  10 
frames  of  data  with  proper  registration,  or  image  alignment. 
The  speckle  noise  effect  is  significantly  suppressed  creating  a 
much  clearer  image  for  further  processing. 
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1.3  Methodology  and  Development  Outline 

The  concept  of  image  registration  tailored  for  coherent  laser  imaging  systems 
is  a  recent  development  with  limited  documentation  and  consequently  limited  re¬ 
search.  Furthermore,  initial  research  on  registration  algorithms  considered  for  use  in 
the  Laservision  system  indicates  only  two  out  of  eight  image  registration  algorithms 
analyzed  by  [5]  show  any  promise  of  both  adequate  error  and  time  performance  met¬ 
rics.  Analysis  conducted  by  [5]  on  these  two  registration  algorithms  uses  mean-square- 
error  (MSE)  and  computer  processing  time  performance  for  the  metric  comparison. 
AFRL/SNJT  provided  real-world  ground-test,  laser  image  data  for  performing  the  re¬ 
search  and  analysis.  A  comparison  and  analysis  study  is  conducted  using  one  of  the 
top  two  image  registration  algorithms  analyzed  by  [5]  and  derived  and  implemented 
in  MATLAB®  versus  the  new  algorithm  designed  in  this  research  effort,  also  derived 
and  implemented  in  Matlab®. 

This  thesis  provides  a  brief  review  of  the  two  registration  algorithms  in  [5]  that 
produced  the  lowest  error  and  time  metrics,  and  it  highlights  strengths  and  weaknesses 
as  applied  to  a  laser  imaging  system.  From  this  background  it  is  evident  that  the 
development  of  a  new  algorithm  that  uses  the  true  statistical  characterization  of  the 
speckle  noise  effect  should  produce  more  accurate  registration  for  a  laser  imaging 
system. 

The  fundamental  design  methodology  incorporates  an  estimation  theory  ap¬ 
proach  described  by  Van  Trees  [8]  to  create  a  new  registration  algorithm  tailored  for 
use  in  a  laser  imaging  system.  This  approach  begins  by  considering  image  registration 
as  a  fundamental  problem  of  estimating  motion  between  scenes,  as  pointed  out  in  [7]. 
This  theoretical  approach  is  covered  in  detail  in  Chapter  II. 

The  scope  of  this  thesis  is  limited  to  the  development  of  a  new  registration  algo¬ 
rithm  design  that  registers  images  with  regard  to  only  translational  shifts  (e.g.  only 
those  shifts  in  the  vertical  and  horizontal  direction).  Hence,  the  algorithm  designed 
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is  called  Laser-illuminated  Translation  Estimation  (LITE)  registration,  and  will  be 
referred  to  as  such  throughout  the  remainder  of  this  document. 

The  results  from  the  LITE  registration  analysis  are  presented  in  Chapter  IV. 
This  thesis  incorporates  both  a  maximum  likelihood  (ML)  estimator  that  measures 
the  estimation  process  efficiency,  as  well  as  a  standard  deviation  error  metric  on  the 
two  algorithms  being  compared.  Additionally,  the  processing  time  performance  met¬ 
ric  analyzed  by  [5]  is  considered.  Performance  verification  of  the  LITE  algorithm 
is  conducted  on  test  images  with  simulated  speckle  noise  versus  one  of  the  top  two 
algorithms  analyzed  by  [5],  the  cross-correlation  algorithm,  using  registration  stan¬ 
dard  deviation  error  measured  in  pixels  over  varying  signal-to-noise  ratios  (SNR) 
(e.g.  light  intensity  levels)  as  the  performance  metric.  Further  test  analysis  compar¬ 
ing  these  same  two  algorithms  is  also  conducted  using  real-world  ground  test  images 
containing  the  actual  speckle  noise  effects  of  the  Laservision  imaging  system.  The 
cross-correlation  algorithm  is  selected  due  to  its  ease  of  implementation  in  Matlab®, 
and  more  importantly  it  can  be  shown  that  cross-correlation  is  the  best  shift  estimator 
for  a  signal  with  white  Gaussian  noise.  This  is  clarified  in  the  Background  section  of 
Chapter  II  and  proved  in  Appendix  A. 

Finally,  this  thesis  presents  conclusions  on  the  LITE  registration  algorithm  de¬ 
sign  and  proposes  avenues  for  future  research  in  laser  image  registration,  as  well  as 
other  image  and  signal  environments  that  could  benefit  from  this  new  shift  estimation 
design. 
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II.  Background 


This  chapter  provides  a  brief  description  of  past  work  accomplished  in  laser  im¬ 
age  processing,  ft  includes  a  brief  review  of  the  two  registration  algorithms 
in  [5]  that  produce  both  the  fastest  processing  times  and  the  lowest  mean-square- 
error  (MSE),  and  it  highlights  their  strengths  and  weaknesses  as  applied  to  a  laser 
imaging  system,  ft  continues  with  a  brief  system  description,  a  short  tutorial  on  how 
speckle  is  created,  a  short  tutorial  on  image  registration,  and  description  of  the  data 
model  used  in  this  thesis. 

2.1  Laser  Image  Registration  Historical  Research 

The  concept  of  image  registration  tailored  for  coherent  laser  imaging  systems 
is  very  new,  and  consequently  documentation  and  research  in  this  image  processing 
discipline  is  limited.  As  such,  there  is  currently  no  known  research  or  development  of 
a  registration  algorithm  designed  using  speckle  noise  statistics  to  improve  registration 
techniques  for  laser  imaging  systems.  Therefore,  the  background  research  is  limited 
to  a  brief  review  of  the  top  two  image  registration  algorithms  analyzed  by  [5]  that 
show  the  most  promise  based  on  their  processing  times  and  error  performance,  and 
it  highlights  their  less  than  optimum  applicability  to  this  problem.  These  candidate 
registration  algorithms  are  cross-correlation  and  vector-block. 

2.1.1  Cross-correlation.  Cross-correlation,  also  referred  to  as  the  phase- 
correlation  method,  uses  fast  Fourier  transforms  (FFT)  to  calculate  a  correlation 
peak  between  two  identical  but  spatially  shifted  images  [5].  This  peak  is  located  at 
pixel  offsets  in  both  the  x  and  y  direction  as  compared  to  the  autocorrelation  peak 
of  the  baseline  image  [5].  Mathematically,  the  cross-correlation  method  is  derived 
through  the  following  steps: 

Consider  two  true  images  i\  and  i2  of  the  same  scene.  They  are  described  by 

k(x,y)  =  i2(x  -  a,y  -  0),  (2.1) 
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where  f2  is  a  shifted  copy  of  the  true  image  i\. 

The  cross-correlation  between  i\  and  z2  is 

N  M 

Ca,p(z,  w)  =  EE  d2{x,y)d1(x  + z,y  +  w),  (2.2) 

x=l  y=  1 

where  d\  and  d 2  are  the  observations  of  the  true  images  i\  and  z2  plus  their  respective 
noise  components  ni  and  n2,  or 


di(x,y)  =  i1(x,y)+ni(x,y),  (2.3) 

<k(x,  y)  =  h(x  -  a,y  -  (3)  +  n2{x,  y).  (2.4) 

Using  2.3  and  2.4,  the  role  of  the  noise  components  is  analyzed  by  taking  the 
Fourier  transform  of  Ca  p 

F{Ca^z,w)}  =  D1(fxJy)D2(fxJy) 


=  [h(fx,  fy)  +  iVrC/x,  /„)]  [r2(fx,  fy )  +  N*(fx,  fy )] 


=  r2(fxJy)l2(fXJy 


i-jZnifxa+fyP) 


+  N1(fxjy)i;(fx,fy) 


+  h(fX ,  fy)N;(fX,  fy)  +  Nl(fx,  fy)N;(fx,  fy ), 


(2.5) 


where  I\  is  the  shifted  version  of  J2  with  the  shift  captured  in  the  linear  phase 
e-j2ir(fxa+fyp)  jqie  frequency  domain. 


The  inverse  Fourier  transform  isolates  the  a  and  /3  shifts: 


+Rn2i1(z1w,a,/3)  +  R 

nin2  (z,w,a,/3),  (2.6) 


Cat/3(z,w)  =  Ra(z  —  a,  w  —  0)  +  Rnii2  (z,  w,  a,  (3) 


+Rn2i1(z,w,a,P)  +  Rnin2(z,w,a,  (3). 


(2.7) 


Since  the  the  image  and  the  noise  are  assumed  to  be  uncorrelated,  and  the  noise 
from  frame  to  frame  is  also  assumed  to  be  uncorrelated,  the  last  three  terms  go  to 
zero;  thus 


Ca#{z,w)  =  Ra{z  -  a,  w  -  0). 


(2.8) 


The  cross-correlation  method  used  in  the  registered  image  of  Figure  1.3  is  “gen¬ 
erally  regarded  as  a  robust  estimator  in  the  presence  of  noise”  [2].  The  drawback 
to  using  this  method  is  that  the  FFTs  require  more  computer  resources  than  the 
Laservision  system  can  allocate  for  this  image  processing  task.  Additionally,  it  can  be 
shown  (Appendix  A)  that  cross-correlation  is  the  best  estimator  for  Gaussian  noise, 
which  as  mentioned  earlier  is  not  the  optimum  distribution  model  for  characterizing 
the  speckle  noise  effect  on  the  observed  image  photon  count  distribution. 

2.1.2  Vector-block.  The  vector-block  method  converts  the  image  matrix  into 
two  vector  sums  along  the  x  and  y  axis  by  summing  the  pixels  along  the  horizontal 
and  vertical  planes.  The  two  vectors  are  then  compared  to  the  baseline  image  vectors 
to  determine  the  shift  between  the  images.  This  procedure  is  depicted  graphically  in 
Figure  2.1,  where  the  column  vector  d^(x,  y )  is  the  sum  of  the  pixels  in  the  image  across 
the  columns  and  the  row  vector  df(x,y)  is  the  sum  of  the  pixels  in  the  image  across 
the  rows.  The  algorithm  uses  these  two  vectors  in  the  cross-correlation  registration 
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Figure  2.1:  Vector-Block  Registration  Method  Illustra¬ 
tion.  The  vector-block  method  converts  the  image  matrix  into 
two  vector  sums  along  the  x  and  y  axis  by  summing  the  pixels 
along  the  horizontal  and  vertical  planes.  The  two  vectors  are 
then  compared  to  the  baseline  image  vectors  to  determine  the 
shift  between  the  images. 

method,  versus  taking  the  cross-correlation  for  each  pixel  in  the  matrix.  The  cross¬ 
correlation  method  is  derived  as  before  using  these  vectors  through  the  following 
steps: 
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Consider  two  true  images  i\  and  i 2  of  the  same  scene.  They  are 


M— 1 

ixi{n)  =  Yt  ii(n,  m)  =  d\.,  (2.9) 

m= 0 


N- 1 

iyi(m)  =  ^  h(n’ m )  =  dr  (2-10) 

n= 0 

where  d l  and  dy  are  the  row  and  column  vectors  from  Figure  2.1. 

Then  the  two  images  are 


ii(n,m)  =  i2(n  -  A x,m-  Ay), 


(2.11) 
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where  i2  is  a  shifted  copy  of  the  true  image  ii,  and  Ax  and  Ay  are  the  shift  values  of 
the  respective  vectors. 

Similarly  for  the  second  image 

M—l 

iX2(n)  =  y  iz{n,m).  (2.12) 

m= 0 

Continuing  with  just  the  row  vector  yields 

m-  1 

ixi  (n)  =  y  ^(n  -A  x,m-  Ay) 

m= 0 


=  ix2(n-  Ax)  (2.13) 

where  ix 2  is  simply  a  shifted  row  vector  version  of  ix\ . 

The  cross-correlation  of  the  row  vectors  is 

N-Ax 

cx(z)  =  y  iX2(n)ixl(z  +  n) 

TL=/\x 


N  ^ xmax 

=  y  ix2(n)ix2(z  +  n  -  Ax)  (2.14) 

and  is  similar  to  the  2-D  cross-correlation  done  previously.  The  Fourier  transform  of 
Equation  2.14  is 

F{C4(3)}  =  i:2(h)IAh)e-i2”A:  (2.15) 

and  the  inverse  Fourier  transform  is 

Cx(z)  =  Rx2(z-  Ax)  (2.16) 
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This  technique,  while  losing  some  accuracy,  reduces  the  cross-correlation  com¬ 
putational  load  due  to  “reducing  the  dimensionality  of  the  calculations  from  N2  to 

2  x  N,  where  N  is  the  number  of  pixels  on  a  side  of  a  square  image”  [5].  However, 
while  it  may  prove  useable  in  the  Laservision  System,  the  fundamental  problem  of 
the  distribution  model  for  the  speckle  noise  effect  on  the  observed  image  still  exists 
for  this  algorithm. 

2.2  Cross-correlation  and  Vector-block  Analysis 

A  self-study  analysis  is  conducted  on  the  two  candidate  registration  algorithms, 
where  simulations  were  performed  to  evaluate  and  compare  their  MSE  and  processing 
time  performance  metrics  as  done  by  [5].  A  detailed  description  of  the  simulation 
methodology  and  analysis  and  results  is  provided  in  Appendix  B. 

2.3  System  Description 

The  Laservision  system  illuminates  a  scene  with  a  laser  beam,  then  receives 
the  reflected  laser  energy.  It  uses  a  “moderate-power  laser  focused  to  illuminate 
targets  at  3  and  10  kilometers.  The  system  receives  reflected  coherent  light  from  the 
laser  using  an  optical  telescope  which  feeds  a  charge-coupled  device  (CCD)  detector 
to  collect  the  scene  intensity”  [5].  The  receiver  is  designed  to  capture  ten  images 
per  second  from  the  target  scene.  Figure  2.2  illustrates  the  basic  system  concept  of 
the  Laservision  system.  The  actual  image  processing  architecture  is  captured  in  the 
block  diagram  of  Figure  2.3,  where  the  incoming  images  may  be  noise  pre-hltered 
before  processing  by  the  image  registration  block  where  the  motion  parameters  (a 
and  f3  shifts)  are  calculated.  Once  the  motion  parameters  are  determined,  the  images 
are  passed  to  the  next  block  where  the  motion  compensation  is  executed  to  align  the 
images  based  on  the  shifts.  After  alignment  the  set  of  images  are  temporally  averaged 
to  output  a  single  noise-reduced  and  clearer  image  for  further  processing.  The  AFRL 
provided  a  large  data  base  of  300  images  of  coherent  reflected  laser  data  at  a  range  of 

3  kilometers  generated  by  the  Laservision  system.  These  target  images  consisted  of 
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Figure  2.2:  Basic  Laservision  System  Concept.  The 

AFRL  Laservision  laser  imaging  system  uses  a  moderate-power 
laser  focused  to  illuminate  targets  at  3  and  10  kilometers.  The 
system  receives  reflected  coherent  light  from  the  laser  using  an 
optical  telescope  which  feeds  a  CCD  detector. 
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Figure  2.3:  Image  Signal  Processing  Architecture.  A 

notional  example  of  signal  processing  executed  within  a  laser 
image  system.  This  example  illustrates  registering,  or  aligning, 
a  set  of  images,  then  temporally  averaging  them  to  create  a 
single  noise-suppressed  image  for  further  processing. 
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Figure  2.4:  Truck  with  Resolution  board  at  3  km.  Ex¬ 
ample  image  from  the  large  laser  image  data  base  provided  by 
the  AFRL. 

various  vehicles,  including  trucks  with  resolution  boards  mounted  on  the  side  and  a 
tank.  Figures  2.4  and  2.5  are  representative  images  from  the  data  set  that  illustrate 
the  speckle  noise  generated  by  the  coherency  of  the  collected  energy  from  the  laser 
illuminator. 

2-4  Coherency  and  Speckle  Noise 

To  help  understand  the  phenomenon  of  speckle  noise  and  how  coherent  laser 
images  create  this  effect,  a  brief  explanation  is  offered.  Referring  to  Figures  2.2  and 
2.6,  a  very  simplistic  scenario  demonstrates  how  speckle  is  generated  in  the  image. 

Recall  from  the  basic  system  concept  illustration  in  Figure  2.2  that  the  laser 
beam  is  reflected  back  at  the  detector  by  all  the  various  surfaces  within  the  field  of 
view  (FOV),  thus  creating  multiple  light  wave  reflections.  Recall  also  that  the  phase 
of  the  projected  light  wave  is  assumed  constant  while  the  detector  is  capturing  a 
particular  scene,  and  that  the  Laservision  system  is  designed  to  capture  ten  images 
per  second.  However,  although  the  phase  is  relatively  constant  for  one  pulse  of  the 
laser  beam  light  (e.g.,  the  scene  capture  interval;  1  //-second  for  Laservision),  it  can 
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Figure  2.5:  Tank  at  3  km.  Example  image  from  the  large 
laser  image  data  base  provided  by  AFRL. 

be  changed  by  the  roughness  of  the  surfaces  within  the  image  scene.  This  variation  in 
surface  roughness  can  be  as  little  as  1/zm  and  still  create  a  phase  change.  A  further 
complication  is  that  the  wavelength  of  the  laser  beam  is  coincidentally  on  the  order 
of  1  /ira  as  well. 

There  may  be  thousands  of  reflected  waves  during  a  capture  period,  but  to 
demonstrate  how  speckle  noise  is  created  in  a  laser  generated  image,  consider  only 
two  points  in  the  scene  reflecting  only  two  waves  back  to  the  CCD  detector.  Assume 
the  variation  between  the  two  surface  points  is  at  least  1/im.  Also,  consider  only  two 
of  the  pixels  in  the  CCD  detector  and  examine  the  effect  on  those  two  pixels  for  two 
extreme  cases  of  the  level  of  light  intensity  received  by  each  pixel. 

Figure  2.6  highlights  these  two  extreme  cases,  the  first  of  which  shows  the  re¬ 
spective  light  waves  reflected  from  points  one  and  two  arriving  perfectly  out  of  phase 
at  CCD  pixel  two.  The  effect  is  a  cancellation  of  the  light  intensity  level  registered  in 
the  CCD  pixel,  thus  creating  a  darker  pixel  point  in  the  observed  image  scene  than 
the  true  single  point  reflection  energy  level.  Similarly,  the  other  extreme  is  when  the 
light  waves  arrive  perfectly  in  phase  at  pixel  one.  The  effect  in  this  case  is  additive 
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Figure  2.6:  Simplistic  Illustration  of  Phase  Coherency 

and  Speckle  Noise.  Surface  roughness  can  cause  the  phase  of 
the  laser  light  to  shift,  creating  varying  light  intensities  as  the 
reflected  light  is  captured  by  the  CCD,  thus  creating  speckle 
noise  in  the  observed  image. 


and  the  light  intensity  level  is  increased;  thus  the  CCD  pixel  registers  a  brighter  point 
in  the  observed  scene  than  the  true  single  point  reflection  energy  level. 

From  this  simplistic  example  of  the  reflected  returns  for  the  extreme  phase 
arrival  cases,  the  multiplicative  nature  of  the  observed  phenomenon  is  clearly  evident. 
The  multiple  variations  of  phase  arrivals  on  the  CCD  detector  from  the  thousands  of 
energy  returns  from  the  image  scene  naturally  cause  varying  light  intensities  on  the 
true  image  single  point  reflections,  thus  blurring  or  “speckling”  the  image  with  noise. 


2. 5  Image  Registration 

Image  registration  is  typically  defined  as  a  process  that  compares  two  or  more 
images  by  calculating  differences  in  translation  (horizontal  and  vertical  shifts),  ro¬ 
tation,  and  scaling  in  order  to  match  or  align  the  images  for  further  processing  [6]. 
Registration  is  therefore  a  key  initial  image  processing  step  before  any  target  detec¬ 
tion  techniques  can  be  implemented.  To  understand  the  basics  of  image  registration, 
four  essential  elements  must  be  defined  as  outlined  by  [1]:  feature  space,  search  space, 
search  strategy,  and  similarity  metric. 
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Figure  2.7:  Search  Space  Transformations.  Translation, 

rotation,  and  scaling  are  the  common  transformations  used  in 
aligning  images  for  registration. 


2.5.1  Feature  Space.  According  to  Brown  [1],  feature  space  is  defined  as  a 
set  of  features  representative  of  the  image  for  matching  purposes.  Examples  include 
pixel  intensity,  image  contours,  edges,  and  line  intersections  [6].  Appropriate  feature 
selection  is  the  foundation  for  developing  an  accurate  registration  algorithm  [1],  For 
the  LITE  registration  algorithm  the  feature  space  is  the  pixel  light  intensity,  since  the 
actual  photon  count  per  pixel  is  the  observed  image  distribution. 


2.5.2  Search  Space.  Search  space  defines  the  transformations  (translation, 
rotation,  scaling)  that  are  used  in  aligning  the  images  during  registration  [1],  Fig¬ 
ure  2.7  illustrates  these  three  common  transformation  types. 


2.5.3  Search  Strategy.  Search  strategy  is  the  process  of  choosing  the  set 
of  transformations  from  the  search  space  that  are  used  in  registering  consecutive 
images  [1] .  As  noted  previously,  in  this  thesis  the  development  of  the  LITE  registration 
algorithm  is  limited  to  registering  images  with  regard  to  only  translational  shifts  (i.e., 
only  those  shifts  in  the  vertical  and  horizontal  direction). 

2.5.4  Similarity  Metric.  According  to  Brown,  the  similarity  metric  in  the 
context  of  image  registration  is  a  measurement  used  to  determine  how  well  the  two 
images  match  [1],  Brown  cites  some  similarity  metrics  as  cross-correlation,  statistical 
correlation  and  matched  Liters,  and  Sum  of  Absolute  Differences  of  Intensity.  This 
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measurement  technique  is  the  heart  of  the  registration  algorithm,  and  is  the  “engine” 
that  determines  how  the  images  are  aligned.  The  log-likelihood  function  used  in  the 
LITE  registration  algorithm  developed  in  this  thesis  is  therefore  the  similarity  metric. 

2.6  Data  Model 

Understanding  the  data  model  involves  understanding  the  relationship  between 
the  images  being  registered  and  the  statistical  noise  distribution  model,  and  that 
relationship  affects  the  shifts  between  images.  According  to  [7],  image  registration  is 
a  fundamental  problem  of  estimating  motion  between  scenes.  This  research  effort  is 
limited  to  transformations  in  translational  motion  between  images  of  the  same  scene, 
i.e.,  shifts  in  the  x  and  y  directions.  In  this  context  [7]  notes  that  motion  estimation 
generally  involves  observed  data  that  follows 


Ri  (x,  V)  =  h  (x,  y)  +  Ni(x,  y) 


(2.17) 


Rz{x,y)  =  h(x  -a,y-  13)  +  N2(x,y), 


(2.18) 


where  the  measured  observation  Ri(x,y)  is  the  baseline  image  consisting  of  the  true 
image  I(x,y)  plus  its  independent  noise  realization  Ni(x,y),  R2(x,y)  is  the  same 
image  shifted  I(x  —  a,y  —  (5)  plus  its  independent  noise  realization  N2(x,y),  and  a 
and  /3  represent  the  shift  values  in  the  x  and  y  axis,  respectively.  In  current  registration 
algorithms  analyzed,  the  affect  of  noise  on  the  observed  image  is  typically  modelled 
as  white  Gaussian  with  variance  a2  [7].  Therein  lies  a  potential  fundamental  problem 
in  using  these  types  of  estimators  for  generating  an  image  registration  algorithm  for 
a  laser  imaging  system  where  the  noise  model,  or  the  effect  of  the  noise  model,  does 
not  follow  a  Gaussian  distribution.  The  estimation  process  that  determines  the  shift 
values  a  and  (3  typically  uses  the  observed  image  as  the  mean  of  the  estimation 
distribution,  thus  not  accounting  for  the  noise  component,  or  the  noise  component 
effect  on  the  true  image,  that  determines  what  type  of  distribution  is  used  in  the 
estimation  calculation  of  a  and  (3. 
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From  Equations  2.17  and  2.18  it  is  evident  that  the  observations  R\  and  R2  have 
the  same  mean  /,  with  the  only  difference  being  the  shifts  a  and  (3.  Furthermore,  in  a 
laser  imaging  system  the  actual  distributions  for  Ni  and  N2  are  unknown.  However, 
in  a  LADAR  imaging  system  exhibiting  speckle  noise,  when  N\  and  N2  are  added  to 
/,  R±  and  R2  exhibit  a  negative  binomial  distribution.  As  noted  before,  this  is  based 
on  Goodman’s  research  of  photon  count  statistics  for  polarized  thermal  light  and  an 
arbitrary  counting  interval  [4],  Hence,  using  a  better  statistical  characterization  of 
the  effects  of  speckle  noise  on  the  observed  image  photon  count  distribution  should 
produce  a  more  accurate  registration  algorithm  for  a  laser  imaging  system. 
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III.  Registration  Algorithm  Design 


The  development  of  a  registration  algorithm  optimized  for  a  laser  imaging  system 
with  speckle  noise  is  fundamentally  an  estimation  problem  involving  the  defi¬ 
nition  of  a  probabilistic  mapping  from  the  parameter  space  (the  true  image  scene)  to 
the  observation  space  (the  observed  image).  The  problem  involves  the  development 
of  an  estimation  algorithm  that  is  an  inverse  mapping  from  observation  space  to  pa¬ 
rameter  space  which  allows  the  estimation  calculation  of  translational  shifts  between 
two  images. 

This  chapter  provides  a  description  of  the  probabilistic  mapping  and  inverse 
mapping  theory  behind  parameter  estimation  as  indicated  in  [8],  and  outlines  the 
design  of  the  registration  algorithm  using  the  estimation  theory  approach. 

3. 1  Estimation  Theory 

The  new  algorithm  design  begins  with  deriving  the  probabilistic  mapping  be¬ 
tween  the  parameter  space  of  the  true  image  scene  and  the  observation  space.  This 
mapping  is  the  foundation  of  estimation  theory,  and  to  gain  a  basic  understanding  of 
this  theoretical  concept,  a  model  of  the  estimation  problem  is  proposed  that  explains 
the  concept  of  mapping  and  inverse  mapping  as  indicated  in  [8,  pages  52-54],  Addi¬ 
tionally,  based  on  the  estimator  types  described  in  [8,  page  65],  a  description  of  the 
estimator  type  used  in  the  LITE  registration  algorithm  design  is  provided. 

3.1.1  Parameter  Estimation  Model.  An  estimation  problem  model  is  graph¬ 
ically  represented  in  Figure  3.1  and  has  four  basic  elements:  Parameter  Space,  Prob¬ 
abilistic  Mapping,  Observation  Space,  and  the  Inverse  Mapping  Estimation  Rule  [8, 
page  53]. 

Parameter  Space.  The  parameter  space  contains  the  output  variables,  or 
parameters  [8] .  In  the  case  of  the  L ADAR  imaging  system,  the  output  variable  is  the 
image  /  generated  from  the  target  scene  and  the  associated  shifts  a  and  (3.  However, 
the  true  image  /  is  actually  an  unwanted  parameter  that  is  considered  a  known,  non- 
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Figure  3.1:  Parameter  Estimation  Model.  This  model 

illustrates  the  mapping  theory  concept  behind  parameter  esti¬ 
mation.  If  the  probabilistic  mapping  effect  on  /  that  creates  the 
observation  R  is  known,  then  R  can  be  mapped  back  to  create 
an  estimate  I(R)  of  /  via  an  estimation  rule. 

random  parameter  constant  that  statistically  represents  the  mean  of  the  photon  count 
distribution  observed  in  R.  The  coherent  nature  of  the  laser  beam  that  creates  the 
speckle  noise  as  described  in  Chapter  II  defines  the  effects  on  /  that  are  observed  in 
R ,  which  is  the  Probabilistic  Mapping  indicated  in  Figure  3.1. 

Probabilistic  Mapping.  The  probabilistic  mapping  is  the  “law  that  governs 
the  effect  of  /  on  the  observation”  [8,  page  53].  As  previously  mentioned  in  the  Prob¬ 
lem  Statement,  speckle  noise  in  a  laser  imaging  system  is  created  by  the  “coherent 
nature  of  the  collected  energy”  [5] .  This  noise  causes  the  observed  image  photon  count 
statistics  to  have  a  negative  binomial  distribution.  This  result  is  based  on  Goodman’s 
research  of  photon  count  statistics  for  polarized  thermal  light  and  an  arbitrary  count¬ 
ing  interval  [4].  From  Goodman  the  distribution  is 


P(R) 


r  (r  +  m) 

T(R  +  1)T(M) 


M 
1  +  ~R 


-i  -R  r 


R 
1+M 


-M 


(3.1) 


where  R  is  the  number  of  counts  observed  in  a  r-second  interval,  M  “represents  the 
number  of  ’degrees  of  freedom’  of  the  distribution  intensity  included  within  the  mea¬ 
surement  interval”  [4],  and  R  represents  the  average  or  mean  of  the  true  image.  M 
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can  also  be  thought  of  as  being  inversely  related  to  the  variance  a2  of  the  observed 
image  photon  count  distribution.  The  value  of  M  is  50,  which  is  a  given  parameter 
determined  experimentally  using  the  real  images  collected  from  the  Laservision  sys¬ 
tem.  Hence,  Equation  3.1  defines  the  probabilistic  mapping  of  the  output  variable  / 
that  is  the  result  seen  in  the  Observation  Space. 

Observation  Space.  The  observation  space  is  simply  what  is  actually  ob¬ 
served  after  the  effects  of  the  probabilistic  mapping.  For  LADAR  images  it  is  the 
image  collected  by  the  system,  denoted  as  R  in  Figure  3.1. 

Estimation  Rule.  The  goal  in  estimation  theory  is  to  use  the  observation  R 
to  estimate  the  true  value  of  the  variable  I  from  the  parameter  space,  based  on  what 
is  known  about  the  probabilistic  mapping  of  I.  As  seen  in  Figure  3.1,  the  estimation 
of  /  based  on  the  observation  R  is  denoted  I(R),  and  the  inverse  mapping  is  referred 
to  as  the  estimation  rule  [8].  The  type  of  estimator  used  in  the  LITE  registration 
algorithm  for  the  estimation  rule  is  discussed  next. 

3.1.2  Maximum  Likelihood  Estimation.  An  abbreviated  description  of  the 
Maximum  Likelihood  (ML)  estimation  procedure  described  by  Van  Trees  [8,  pages  63- 
65]  provides  the  background  for  the  estimation  procedure  incorporated  in  the  LITE 
algorithm  design.  Van  Trees  describes  the  likelihood  function  as  a  probability  function 
pr\i(R\I),  which  is  a  function  of  /  [8,  page  65].  Since  the  natural  logarithm  is  often 
used  in  this  estimation  procedure,  it  is  sometimes  referred  to  as  the  log  likelihood 
function  [8].  The  ML  estimator  Imi(R )  is  the  value  of  /  “at  which  the  likelihood 
function  is  a  maximum”  [8,  page  65].  If  the  maximum  value  is  part  of  I's  parameter 
space,  then  the  likelihood  equation  can  be  determined  by  differentiating  lnpr\i(R,\I) 
with  respect  to  I  and  setting  equal  to  zero: 

d\npr\i(R\I) 

dl 
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This  procedure  provides  the  foundational  approach  for  the  LITE  registration 


algorithm  design. 


3.2  Algorithm  Design  Using  Maximum  Likelihood  Estimation  Theory 

Since  the  observations  have  a  negative  binomial  distribution  form  as  described 
by  Equation  3.1  and  the  true  image  /  is  considered  as  a  non-random  parameter  con¬ 
stant  that  statistically  represents  the  mean  of  the  photon  count  distribution  observed 
in  R,  then  from  Equation  3.1,  the  probability  density  function  (PDF)  for  the  first 
observed  image  R\  is 
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Next  the  ML  estimator  Imf  for  image  one  is  derived  by  first  taking  the  natural 
logarithm  of  Equation  3.3,  then  taking  the  partial  derivative  with  respect  to  one 
discrete  point  (x0,?/o): 
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which,  upon  being  set  equal  to  zero  to  solve  for  the  maximum  likelihood  function, 
simplifies  to 


Ri{x0,yo)  (  M  \  _  M  (M_ 
1  +  w^)  v2(^o,yo);  i  +  W2 
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Multiplying  the  right  term  by  ,  a  common  denominator  is  found  so  that 


n  =  Ri(x0,y0)  -  MI(x0,yo) 

I(x0,y0)[I(x0,yo)  +  M}' 

Solving  for  I(x o,  yo),  the  ML  estimator  for  a  discrete  point  in  image  one  is  simply 
the  observation  point  of  image  one 

Imi(xo,yo)  =  Ri{x0,y0),  (3.8) 

and  it  follows  that  for  the  entire  image  the  ML  estimator  is 


Imi(x,y)  =  Ri{x,y).  (3.9) 

Continuing  with  image  two,  Equation  3.9  can  be  substituted  into  the  PDF  for 
the  second  image;  note  that  the  shift  difference  between  the  observed  images  R±  and 
i?2  is  accounted  for  in  R\.  Capturing  the  shifts  in  this  way  allows  for  the  isolation  of 
a  and  (3  in  order  to  solve  for  their  respective  estimators. 
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Next,  to  derive  ML  estimators  for  a  and  /?,  a  log-likelihood  is  calculated  by 
taking  the  natural  logarithm  of  Equation  3.10, 
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(3.11) 


By  inspection  of  the  terms  in  Equation  3.11,  it  is  clear  that  the  first  three  are 
not  affected  by  a  and  (3.  Thus,  they  will  not  affect  the  value  of  the  log-likelihood 
summation.  The  fifth  term  is  affected  by  the  a  and  j3  shifts  only  around  the  edges  of 
the  image.  At  the  edges  pixel  values  could  potentially  vary  significantly  depending  on 
the  intensity  variations  between  images  along  the  edges.  This  could  potentially  add 
or  subtract  signihcantly  in  the  summation.  However,  because  the  Laservision  sys- 
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tem  typically  captures  images  well  within  the  laser  beam’s  FOV  leaving  fairly  dark 
borders,  it  is  assumed  that  the  edge  effects  are  negligible  and  the  fifth  term  can  be 
ignored.  Hence,  Equation  3.11  simplifies  to  a  correlation  term  which  results  in 
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Then  by  combining  the  terms  of  the  natural  log  argument  over  a  common  de¬ 
nominator  and  taking  the  inverse,  the  negative  sign  is  eliminated  via  the  log  rule 
ln(  )  =  —  ln(x)  to  produce 
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Simply  put,  the  a  and  /3  shifts  that  create  a  peak  value  of  the  correlation  function 
are  the  estimators  for  a  and  (3: 
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This  new  algorithm  design  is  called  the  Laser-illuminated  Translation  Estima¬ 
tion  (LITE)  registration  algorithm. 

Since  the  LITE  algorithm  is  tested  against  the  cross-correlation  algorithm,  a 
quick  comparative  examination  of  the  two  algorithm  designs  is  helpful.  First,  the 
LITE  algorithm  can  be  simply  manipulated  by  allowing  the  log  function  term  to 
equal: 
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which  could  be  performed  as  a  pre-processing  step  as  part  of  the  actual  computer 
implementation  of  the  algorithm.  This  adjustment  allows  the  LITE  algorithm  to  be 


expressed  as 
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which  can  now  be  compared  to  the  cross-correlation  algorithm  from  Appendix  A 
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This  brief  comparison  simply  highlights  the  fact  that  the  LITE  algorithm  is 
procedurally  similar  to  the  cross-correlation,  with  the  exception  of  the  added  division 
and  natural  logarithm  floating  point  operations.  Unfortunately,  while  this  should  not 
add  significantly  to  overall  processing  time,  it  is  not  likely  to  provide  a  faster  algo¬ 
rithm  design  for  the  Laservision  system.  However,  if  the  performance  improvement 
over  the  cross-correlation  algorithm  is  significant  enough,  it  will  demonstrate  that  im¬ 
plementing  true  statistics  in  the  registration  algorithm  design  improves  overall  laser 
image  registration  accuracy.  This  result  ultimately  serves  to  improve  speckle  noise 
suppression  to  produce  a  single  image  with  adequate  resolution  to  allow  detection 
and  identification  algorithms  to  operate  accurately  or  to  allow  system  operators  to 
perform  target  detection  and  identification  within  a  scene. 


IV.  Performance  Results  and  Analysis 


According  to  Robinson  [7],  performance  characterization  is  critical  to  measuring 
algorithm  optimization.  For  the  comparative  tests  a  pixel  standard  deviation 
error  measurement  metric  on  the  algorithm  itself  versus  another  registration  algorithm 
is  used,  as  well  as  consideration  of  the  processing  time  performance  metric  analyzed 
by  [5], 

Performance  verification  of  the  LITE  algorithm  is  conducted  on  test  images 
with  simulated  speckle  noise  versus  one  of  the  top  two  algorithms  analyzed  by  [5],  the 
cross-correlation  algorithm.  The  performance  metric  used  for  the  simulated  testing  is 
registration  standard  deviation  error  measured  in  pixels  over  varying  signal-to-noise 
ratios  (SNRs)  (e.g.  light  intensity  levels).  Further  test  analysis  comparing  the  two 
algorithms  is  conducted  using  real-world  ground  test  images  containing  the  actual 
speckle  noise  effects  of  the  Laservision  imaging  system.  The  performance  metric  used 
for  the  real  data  testing  is  registration  standard  deviation  error  metric  measured  as 
light  intensity  at  each  pixel  over  varying  SNRs. 

This  chapter  outlines  the  testing  methodology  incorporated  for  both  the  sim¬ 
ulated  speckle  noise  images  and  the  real-world  images  with  speckle,  and  the  results 
and  analysis  for  both  the  simulated  data  and  the  real  data. 

4-1  Testing  Methodology 

4-1.1  Simulated  Speckle  Noise  Image  Testing.  The  simulated  speckle  noise 
image  data  is  developed  to  perform  a  comparative  analysis  of  the  LITE  algorithm 
versus  a  cross-correlation  algorithm.  The  comparative  analysis  evaluates  the  im¬ 
provement  realized  by  implementing  the  negative  binomial  distribution  in  the  param¬ 
eter  estimation  versus  the  traditional  Gaussian  distribution  assumption.  Using  the 
Matlab®  negative  binomial  random  generator  function,  two  independent  negative 
binomial  noise  realizations  were  added  to  the  true  image  and  a  copy  of  the  true  image. 
Figures  4.1  and  4.2  illustrate  the  twin  images  before  and  after  the  addition  of  the  sim¬ 
ulated  speckle  noise.  The  image  in  Figure  4.1  is  generated  using  the  real-world  images 
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Figure  4.1:  True  Image  Scene  without  Noise.  This  rep¬ 
resents  the  unshifted  pair  of  noiseless  images  used  for  the  simu¬ 
lated  speckle  noise  testing  and  analysis. 


Figure  4.2:  Twin  Images  with  Speckle  Noise.  This  rep¬ 
resents  the  unshifted  pair  of  images  after  the  simulated  speckle 
noise  is  added.  Each  image  has  a  random,  independent  realiza¬ 
tion  of  the  speckle  noise. 

collected  by  Laservision,  which  are  processed  to  provide  a  noiseless  image  that  is  used 
to  create  the  simulated  speckle  noise  images  in  Figure  4.2.  Simulating  the  negative 
binomial  noise  in  a  noiseless  scene  serves  to  test  the  algorithms  against  strictly  speckle 
noise,  and  it  avoids  the  potential  introduction  of  additional  noise  sources  that  may 
be  present  in  a  real-world  image.  This  simulation  environment  tests  the  LITE  algo¬ 
rithm,  designed  only  with  speckle  noise  statistics,  and  the  cross-correlation  algorithm, 
designed  with  Gaussian  noise  statistics. 

Since  the  images  are  copies  of  each  other,  there  are  no  translational  shifts  be¬ 
tween  them;  i.e.,  they  are  in  effect  registered.  This  condition  requires  the  registration 
algorithms  to  correct  only  for  false  shifts  created  by  the  speckle  noise,  thus  isolating 


30 


the  algorithm  performance  comparison  to  speckle  noise  generated  pixel  shift  errors. 
Also,  the  degree  of  freedom  value  M  influences  the  degree  to  which  the  speckle  noise 
affects  the  image,  and  the  value  used  is  fifty,  which  is  calculated  via  experimentation 
as  indicated  earlier.  Furthermore,  the  average  SNR  value  for  this  scene  is  measured 
as  approximately  six,  which  establishes  the  upper  end  of  the  SNR  range  used  for  the 
comparison. 

The  two  images  with  independent  speckle  noise  realizations  are  registered  using 
a  standard  cross-correlation  algorithm  and  the  LITE  algorithm,  both  implemented  in 
Matlab®.  The  procedure  of  adding  independent  noise  realizations  to  each  image 
and  registering  with  the  two  algorithms  is  repeated  one-thousand  times  to  simulate 
one-thousand  independent  noise  realizations  and  registrations  at  each  SNR  value. 
The  registration  shifts  estimated  by  each  algorithm  for  each  noise  realization  are 
used  to  calculate  a  registration  standard  deviation  error  metric  of  the  x  and  y  shifts 
calculated  by  each  algorithm,  measured  in  integer  pixel  values.  The  noise  realization 
and  registration  steps  above  are  repeated  for  each  SNR  value  to  produce  a  comparison 
of  the  algorithms  by  calculating  the  pixel  shift  standard  deviation  for  each  algorithm: 
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where  dx  and  dy  represent  the  measured  shift  values  in  the  x  and  y  directions,  re¬ 
spectively,  and  N  is  the  number  of  the  noise  realizations  calculated. 

The  light  intensity  signal-to-noise  ratio  (SNR)  of  the  images  is  varied  from  0.8 
to  7  to  simulate  very  low  to  very  high  light  levels.  At  the  upper  end  of  this  range  it  is 
anticipated  that  the  algorithms  will  perform  equally  well.  This  expectation  is  due  to 
the  higher  light  intensity  level,  which  causes  the  negative  binomial  statistical  distri¬ 
bution  of  the  speckle  noise  to  begin  resembling  a  Gaussian  distribution.  Thus,  most 
registration  algorithms  will  perform  equally  well,  particularly  the  cross-correlation 
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algorithm,  which  is  known  to  be  the  best  estimator  for  signals  with  Gaussian  noise 
(ref  Appendix  A).  Similarly,  for  intensity  levels  that  are  significantly  lower,  the  noise 
is  significant  enough  that  it  is  anticipated  the  algorithms  will  perform  equally  poorly. 
Varying  the  SNR  light  intensity  levels  provides  a  means  to  analyze  the  algorithms  and 
determine  if  there  is  an  optimum  SNR  range  where  the  LITE  registration  algorithm 
performs  better  than  the  cross-correlation  algorithm. 

4-1.2  Real-world  Speckle  Noise  Image  Testing.  The  comparative  analysis  of 
the  LITE  algorithm  versus  a  cross-correlation  algorithm  is  continued  on  a  set  of  the 
real-world  data  provided  from  the  Laservision  ground  tests.  The  objective  of  testing 
and  analyzing  the  two  algorithms  with  real  data  is  to  determine  if  the  LITE  algorithm 
outperforms  the  cross-correlation  algorithm  within  the  range  that  the  simulated  data 
testing  indicates  (i.e.,  between  approximately  3  -  5.5  average  SNR)  for  real-world 
images.  Figure  4.3  illustrates  the  target  scene  of  a  truck  with  a  resolution  board  that 
is  used  in  this  testing. 


Figure  4.3:  Real-world  Target  Scene.  This  scene  is  the 

real-world  ground  test  data  collected  by  the  Laservision  system 
of  a  truck  with  resolution  target  board,  and  is  the  scene  used 
for  the  LITE  vs.  Cross-correlation  comparison  and  analysis. 
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Since  the  LITE  algorithm  model  is  designed  with  and  the  simulated  data  is 
created  with  only  speckle  noise  statistics,  this  scene  represents  the  shortest  range 
(3  km)  that  the  Laservision  system  was  tested  that  should  contain  mostly,  if  not 
only,  speckle  noise.  In  other  words,  this  data  set  should  minimize  any  other  noise 
sources  (i.e.,  atmospheric  turbulence,  thermal,  etc.)  that  could  cause  a  performance 
comparison  anomaly.  Also,  the  resolution  board  provides  sub-regions  which  are  used 
to  find  lower  average  SNR  scenes  within  the  desired  average  SNR  range. 

Fifty  real-world  images  of  the  truck  with  resolution  target  board  are  used  from 
the  Laservision  image  data  base;  each  contains  random,  independent  speckle  noise 
realizations  and  unknown  shifts  between  the  images.  Since  the  true  translational 
shifts  are  not  known,  the  registration  shifts  estimated  by  each  algorithm  for  each 
noise  realization  are  used  to  calculate  a  registration  standard  deviation  error  metric 
measured  as  light  intensity  at  each  pixel.  Thus,  the  error  metric  calculation  for  each 
algorithm  is 
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where  Dk  is  each  image  with  its  associated  shift  value  and  /  represents  the  mean  of 
the  images  intensity  level  at  each  pixel.  This  mean  is  determined  when  the  algorithm 
registers  all  the  images  and  they  are  averaged,  thus  creating  one  set  of  light  intensity 
mean  values  for  each  pixel  location  averaged  for  all  fifty  images.  K  is  the  number  of 
images  used  for  registration  (fifty),  and  M  and  N  are  the  dimensions  of  the  image  in 
the  x  and  y  directions,  i.e.,  the  number  of  pixels  per  side,  which  are  500  x  500  for  the 
full  scene  and  42  x  42  for  the  smaller  scenes.  The  reason  for  using  this  smaller  image 
scene  is  explained  later. 

The  first  real  image  tested  is  the  full  scene  as  shown  in  Figure  4.3,  which  has 
a  measured  average  SNR  of  6.02.  This  image  provides  a  sample  point  at  the  upper 
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bound  of  the  average  SNR  range.  As  in  the  simulated  data,  the  results  are  anticipated 
to  show  both  algorithms  will  perform  equally  well,  mainly  because  the  speckle  noise 
begins  to  resemble  a  Gaussian  distribution  at  higher  light  intensity  levels  as  described 
earlier.  The  goal  then  is  to  find  average  SNRs  within  this  image  scene  that  falls  within 
the  window  where  the  LITE  algorithm  is  expected  to  show  improvement,  which  is 
where  the  smaller  image  scenes  come  into  use  for  the  testing  scenario. 

The  full  scene  is  scanned  to  End  smaller  regions  with  lower  average  SNRs  to 
find  representative  samples  across  the  desired  SNR  range  (3  -  5.5).  Furthermore,  the 
sample  scenes  were  chosen  such  that  the  resolution  bars  were  as  close  to  the  center 
as  possible  leaving  as  dark  of  border  as  possible.  This  selection  criteria  was  used  to 
minimize  the  border  effects  that  were  assumed  to  be  minimal  in  Chapter  III,  thus 
allowing  both  algorithms  to  perform  as  optimally  as  possible  within  their  designs. 
An  exhaustive  search  is  performed  using  the  selection  criteria  above  and  four  sample 
scenes,  each  42  x  42  pixels,  are  collected  with  average  SNRs  of  4.17,  4.36,  4.44,  and 
5.15.  Note  that  4.17  was  the  lowest  average  SNR  found  that  met  the  selection  criteria. 
However,  the  samples  at  4.36  and  4.44  are  in  the  heart  of  the  testing  window  where 
the  simulated  data  showed  a  peak  improvement  of  approximately  0.16  pixel  around 
4.4  average  SNR.  This  average  SNR  is  where  the  LITE  algorithm  is  expected  to  have 
the  best  performance  improvement  over  the  cross-correlation  algorithm. 

4-2  Results  and  Analysis 

4-2.1  Simulated  Speckle  Noise  Data.  Figure  4.4  illustrates  the  registration 
error  of  the  LITE  registration  algorithm  versus  that  of  the  cross-correlation  algorithm 
across  the  varying  light  intensity  SNRs.  As  anticipated,  the  upper  range  (approxi¬ 
mately  5.5  and  greater)  clearly  demonstrates  that  the  two  algorithms  begin  to  perform 
equally  as  well  with  little  error  in  the  shift  estimations.  Also  clearly  evident  is  that 
for  very  low  SNRs  (approximately  below  2)  the  two  algorithms  are  performing  equally 
poorly.  In  other  words,  the  noise  is  significant  enough  that  the  pixel  error  is  signifi¬ 
cant  for  both  algorithms,  with  little  to  no  difference  between  them.  However,  within 
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Figure  4.4:  Simulated  Data  Registration  Error  Stan¬ 

dard  Deviation,  LITE  vs.  Cross-Correlation.  The  sim¬ 
ulated  data  performance  results  demonstrate  that  the  LITE 
algorithm  shows  improved  performance  over  cross-correlation, 
specifically  within  the  3  to  5.5  SNR  range,  where  there  is  an 
average  improvement  of  0.1  pixels  with  a  peak  of  approximately 
0.16  around  4.4  average  SNR. 

the  SNR  range  of  3  to  5.5  the  LITE  algorithm  has  improved  performance  over  the 
cross-correlation  algorithm.  The  average  improvement  in  this  range  is  0.1  pixels,  with 
a  peak  of  approximately  0.16  around  4.4  average  SNR. 


4-2.2  Real-world  Speckle  Noise  Data.  Figure  4.5  shows  the  real-data  full- 
scene  of  the  truck  and  resolution  target  board,  and  a  side-by-side  comparison  of  the 
LITE  versus  Cross-correlation  algorithms  both  visually  and  with  the  light  intensity 
standard  deviations  noted  above  each  image.  This  comparison  illustrates  that  there 
is  little  to  no  difference  visually  between  the  two  algorithms  at  the  higher  average 
SNR  range,  as  expected.  Also,  the  light  intensity  standard  deviations  are  comparable 
at  this  average  SNR.  Unexpectedly,  though,  at  the  other  average  SNR  values  of  4.17, 
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Figure  4.5:  LITE  vs.  Cross-correlation  Comparison, 

Full  Scene,  Average  SNR  =  6.  This  side-by-side  comparison 
illustrates  that  there  is  little  to  no  difference  visually  between  the 
two  algorithms  at  the  higher  average  SNR  range,  as  expected. 

The  light  intensity  standard  deviations  are  also  comparable  at 
this  average  SNR. 

4.36,  4.44  and  5.15,  the  two  algorithms  are  performing  nearly  identically  as  well, 
with  the  Cross-correlation  showing  a  very  negligible  advantage.  Figures  4.6,  4.7,  4.8, 
and  4.9  highlight  this  unfortunate  outcome. 

Finally,  Figure  4.10  depicts  pixel  intensity  standard  deviations  versus  average 
SNR  for  each  algorithm  to  graphically  highlight  the  unexpected  results  for  the  real- 
data  testing.  There  are  potentially  two  initial  reasons  that  may  have  caused  this 
outcome,  which  are  discussed  in  the  conclusions  of  Chapter  V. 


4-2.3  Processing  Time.  As  mentioned  earlier,  the  processing  time  perfor¬ 
mance  metric  analyzed  by  [5]  is  considered,  which  is  measured  by  implementing  the 
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basic  Matlab®  tic  and  toe  functions  around  the  main  loops  for  each  algorithm.  Sur¬ 
prisingly,  the  LITE  algorithm  appears  to  consistently  run  slightly  faster  than  the 
Cross-correlation  algorithm.  Specifically,  for  processing  the  larger  500  x  500  images, 
the  LITE  algorithm  performed  approximately  13%  faster,  and  for  the  smaller  42  x  42 
scenes  it  performed  approximately  17%  faster.  The  potential  reasons  for  this  result 
are  discussed  further  in  the  conclusions  of  Chapter  V. 


LITE,  <T=  106.53 


CC,  cr=  105.91 


Figure  4.6:  LITE  vs.  Cross-correlation  Comparison, 

Sub-Region  Scene,  Average  SNR  =  4.17.  This  comparison 
illustrates  that  there  is  an  unexpected  result  showing  little  to  no 
difference  either  visually  or  between  the  light  intensity  standard 
deviations  at  this  lower  average  SNR. 
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Figure  4.7:  LITE  vs.  Cross-correlation  Comparison, 

Sub-Region  Scene,  Average  SNR  =  4.36.  This  compari¬ 
son  illustrates  that  there  is  an  unexpected  result  showing  little 
to  no  difference  either  visually  or  between  the  light  intensity 
standard  deviations  at  this  average  SNR  that  is  near  the  value 
that  the  simulated  data  showed  where  the  LITE  with  the  most 
improvement. 
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Figure  4.8:  LITE  vs.  Cross-correlation  Comparison, 

Sub-Region  Scene,  Average  SNR  =  4.44.  This  compari¬ 
son  illustrates  that  there  is  an  unexpected  result  showing  little 
to  no  difference  either  visually  or  between  the  light  intensity 
standard  deviations  at  this  average  SNR  that  is  at  the  value 
that  the  simulated  data  showed  where  the  LITE  with  the  most 
improvement. 
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Figure  4.9:  LITE  vs.  Cross-correlation  Comparison, 

Sub-Region  Scene,  Average  SNR  =  5.15.  This  compari¬ 
son  illustrates  that  there  is  an  unexpected  result  showing  little 
to  no  difference  either  visually  or  between  the  light  intensity 
standard  deviations  at  this  average  SNR  that  is  near  the  value 
that  the  simulated  data  showed  where  the  LITE  with  the  most 
improvement. 
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Figure  4.10:  Real-world  Data  Pixel  Intensity  Standard 
Deviation,  LITE  vs.  Cross-Correlation.  The  real-world 
data  performance  results  demonstrate  that  the  LITE  algorithm 
did  not  outperform  the  Cross-correlation  algorithm  as  expected, 
but  rather  did  as  well  in  the  heart  of  the  average  SNR  range, 
and  negligibly  worse  at  the  upper  average  SNR  range.  The  two 
potential  reasons  are  discussed  in  the  conclusions  of  Chapter  V. 
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V.  Conclusions 


This  research  effort  focuses  on  developing  a  robust  optical  image  registration 
algorithm  for  negating  speckle  noise  effects  in  coherent  images  generated  by  a 
laser  imaging  system,  named  the  Laser-illuminated  Translation  Estimation  (LITE) 
registration  algorithm.  This  chapter  provides  closing  remarks  beginning  with  a  recap 
of  the  highlights  of  the  research  and  conclusions  about  the  LITE  algorithm,  and 
finishing  with  potential  areas  for  future  research. 

5. 1  Summary 

The  concept  of  image  registration  tailored  for  coherent  laser  imaging  systems 
is  very  new,  and  research  on  related  registration  algorithms  includes  a  brief  review 
of  the  top  two  image  registration  algorithms  analyzed  by  [5],  the  cross-correlation 
and  vector-block  methods.  The  cross-correlation  method  is  “generally  regarded  as  a 
robust  estimator  in  the  presence  of  noise”  [2],  but  the  drawback  is  that  the  use  of  FFTs 
requires  more  computer  resources  than  the  Laservision  system  can  allocate,  and  it  is 
known  that  cross-correlation  is  the  best  estimator  for  Gaussian  noise  (ref  Appendix  A). 
The  vector-block  method  does  reduce  the  cross-correlation  computational  load  due 
to  reducing  the  dimensionality  of  the  calculations  from  N2  to  2  x  iV;  however,  the 
fundamental  problem  of  the  assumed  Gaussian  speckle  noise  distribution  model  still 
exists  for  this  algorithm.  The  striking  results  from  the  comparison  study  of  these  two 
algorithms  (ref  Appendix  B)  is  that  the  processing  speed  of  the  vector-block  method  is 
over  two  times  faster  due  to  the  dimensionality  reduction  of  the  calculations.  Equally 
striking  is  the  extremely  small  difference  in  MSE  performance,  which  translates  into 
maintaining  the  quality  in  the  final  image  product. 

The  system  description  highlighted  the  AFR.L  Laservision  system,  which  illu¬ 
minates  a  scene  with  a  laser  beam,  then  receives  the  reflected  laser  energy  using  an 
optical  telescope  which  feeds  a  CCD  detector.  The  receiver  is  designed  to  capture 
ten  images  per  second  of  the  target  scene,  and  it  is  these  ten  essentially  identical 
images,  offset  by  only  translational  motion,  that  must  be  properly  registered.  Also, 
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the  coherent  nature  of  laser  light  causes  the  speckle  noise  phenomenon,  and  no  known 
algorithm  in  the  past  has  been  specifically  designed  to  register  laser  generated  images 
using  negative  binomial  statistics  in  the  shift  estimation  algorithm  design. 

Image  registration  is  typically  defined  as  a  process  that  compares  two  or  more 
images  by  calculating  differences  in  translation  (horizontal  and  vertical  shifts),  ro¬ 
tation,  and  scaling  in  order  to  match  or  align  the  images  for  further  processing  [6], 
and  it  is  a  key  initial  image  processing  step  before  target  detection  techniques  can 
be  implemented.  Also,  recall  that  according  to  Robinson  [7],  image  registration  is 
a  fundamental  problem  of  estimating  motion  between  scenes,  and  the  algorithm  de¬ 
sign  is  fundamentally  an  estimation  problem  involving  a  probabilistic  mapping  from 
the  parameter  space  (the  true  image  scene)  to  the  observation  space  (the  observed 
image).  This  problem  involves  the  development  of  an  algorithm  that  is  an  inverse 
mapping  from  observation  space  to  a  parameter  space  that  allows  the  calculation  of 
the  translational  shifts  between  two  images. 

5.2  Conclusions 

The  LITE  registration  algorithm  is  designed  using  speckle  noise  statistics.  It  is 
found  via  simulation  that  using  the  correct  statistics  produces  a  registration  algorithm 
with  improved  performance  relative  to  an  algorithm  derived  using  noise  distributions 
that  are  not  consistent  with  the  data  they  are  processing;  i.e. ,  the  white  Gaussian 
noise  assumption.  However,  the  real  data  comparison  tests  did  not  provide  the  re¬ 
sults  verifying  that  using  an  algorithm  designed  specifically  with  the  true  speckle 
noise  statistics  outperforms  an  algorithm  design  not  characterized  with  the  true  noise 
statistics.  A  couple  of  hypothesized  explanations  are  offered  in  the  real  data  conclu¬ 
sions. 


5.2.1  Simulated  Data.  The  simulated  data  results  indicate  that  the  LITE 
algorithm  shows  promise  of  being  valuable  for  low  light  level  imaging  scenarios,  specif¬ 
ically  in  the  3  to  5.5  SNR  range.  The  average  improvement  in  this  SNR  range  is  0.1 
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pixels,  with  a  peak  of  approximately  0.16  around  4.5  SNR.  This  result  may  not  appear 
to  be  very  significant;  however,  at  longer  ranges  it  could  prove  valuable  in  suppressing 
speckle  noise  enough  to  be  noticeable  to  either  the  human  eye  for  operator  target  iden¬ 
tification  or  to  allow  improved  target  detection  and  recognition  algorithms  to  perform 
better. 

Further  observations  indicate  that  at  very  low  light  levels  (i.e. ,  below  2  SNR) 
the  noise  is  significant  enough  that  both  algorithms  perform  equally  as  poorly  in  that 
the  pixel  error  standard  deviation  becomes  progressively  worse  for  both,  with  little  to 
no  difference  between  them.  Likewise,  at  high  light  levels  the  two  algorithms  perform 
equally  well  since  the  probability  density  function  of  the  data  becomes  similar  to  a 
Gaussian  distribution.  In  these  situations  traditional  registration  algorithms  behave 
similarly  to  the  LITE  algorithm  and  might  be  preferable  in  that  they  are  faster  and 
require  fewer  floating  point  operations  to  execute.  However,  the  research  conducted 
to  develop  the  LITE  registration  algorithm  demonstrates  significant  promise  in  im¬ 
plementing  true  statistics  in  the  registration  algorithm  design,  thus  improving  overall 
laser  image  registration,  and  it  has  clearly  laid  the  groundwork  for  continued  research. 

5.2.2  Real  Data.  The  real  data  results  indicate  that  the  LITE  algorithm  did 
not  outperform  the  Cross-correlation  algorithm  as  expected,  but  rather  did  as  well 
in  the  center  of  the  average  SNR  range,  and  negligibly  worse  at  the  upper  average 
SNR  range.  The  two  potential  reasons  for  this  outcome  are  either  there  are  other 
noise  sources  within  the  real  data  beyond  only  speckle,  or  the  calculation  of  the  M 
value  provided  for  the  testing  is  not  accurate.  If  there  are  other  noise  sources  present 
in  the  data  set,  then  this  will  cause  the  LITE  algorithm  to  perform  less  effectively 
because  it  is  designed  specifically  with  speckle  noise  statistics  and  assumes  that  the 
short-range  real  data  set  contained  only,  or  mostly,  negative  binomial  speckle  noise. 
The  M  value  was  extrapolated  from  the  Laservision  image  data  base  set  because  the 
system  was  not  instrumented  during  the  ground  tests  to  measure  and  characterize 
the  sensor  with  respect  to  its  M  value.  A  quick  test  and  analysis  varying  the  M 
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value  in  the  Mat  lab®  code  from  1  to  100  provided  no  significant  changes  in  the  LITE 
algorithms  performance.  If  the  M  value  is  actually  much  higher  than  calculated, 
then  this  will  have  the  same  effect  as  increasing  the  SNR  light  intensity  level,  which 
in  turn  causes  the  statistical  distribution  of  the  noise  to  begin  resembling  Gaussian 
noise.  Thus,  the  Cross-correlation  algorithm  would  tend  to  outperform  the  LITE 
algorithm  in  this  situation.  Further  analysis  to  determine  the  true  M  value  may  be 
necessary,  as  well  as  an  in  depth  analysis  of  the  data  sets  to  quantify  what  other 
noise  sources  may  be  present.  The  Future  Research  section  discusses  some  ideas  on 
accounting  for  other  noise  sources  and  possibly  creating  an  adaptive,  more  dynamic 
algorithm  by  incorporating  the  M  value  into  the  estimation  process. 

5.2.3  Processing  Time.  The  processing  time  performance  metric  analyzed 
by  [5]  is  measured  by  implementing  the  basic  Mat  lab®  tic  and  toe  functions  around  the 
main  loops  for  each  algorithm.  Initial  indications  are  that  the  LITE  algorithm  appears 
to  consistently  run  slightly  faster  than  the  Cross-correlation  algorithm.  Specifically, 
for  processing  the  larger  500  x  500  images,  the  LITE  algorithm  performed  approx¬ 
imately  13%  faster,  and  for  the  smaller  42  x  42  scenes  it  performed  approximately 
17%  faster.  This  result  was  not  expected,  but  upon  further  analysis  of  the  Matlab® 
code,  the  potential  reasons  for  this  may  lie  in  the  number  of  operations  that  are 
accomplished  outside  the  main  shift  estimation  algorithm  loop  for  each  of  the  regis¬ 
tration  algorithms.  For  the  LITE  algorithm  there  are  four  operations  involving  the 
logarithm,  conjugate,  and  FFT  that  are  one  time  operations  performed  outside  of  the 
loop.  Specifically,  there  is  only  one  FFT  operation  executed  and  it  is  accomplished 
outside  the  loop.  Conversely,  the  Cross-correlation  algorithm  has  one  FFT  outside 
the  loop  and  another  inside  the  loop  along  with  a  conjugate  operation. 

5.3  Avenues  for  Future  Research 

There  are  several  areas  that  are  ripe  for  continuing  with  this  particular  algorithm 
design  or  for  branching  off  into  similar  fields.  The  following  is  a  brief  list  of  the  avenues 
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available  for  future  research,  along  with  a  short  description  of  what  research  could  be 
conducted  in  each  area. 

5.3.1  Cramer- Rao  Lower  Bound  Analysis.  Probably  the  most  obvious  fu¬ 
ture  sub-research  area  that  could  benefit  laser  image  registration  algorithm  design 
involves  calculation  of  the  Cramer- Rao  Lower  Bound.  According  to  [7],  the  Crarner- 
Rao  bound  helps  to  characterize  “the  ‘difficulty’  with  which  a  set  of  parameters  can 
be  estimated  using  a  given  data  model  from  an  information  theoretic  standpoint.” 
Therefore,  the  calculation  would  provide  a  lower  bound  to  how  well  a  laser  image  reg¬ 
istration  algorithm  should  be  expected  to  perform  and  could  determine  if  any  more 
effort  should  be  expended  on  continuing  to  improve  the  LITE  algorithm. 

5.3.2  Adaptive  Joint  Estimator  Design.  A  very  promising  avenue  is  to 
redesign  the  estimator  to  adaptively  account  for  both  varying  values  of  M  and  the 
possibility  of  prior  knowledge  of  I.  An  adaptive  joint  estimator  incorporating  M,  /, 
a,  and  j3  would  significantly  boost  the  robustness  of  the  LITE  registration  algorithm. 

5.3.3  Other  Transformation  Effects.  Another  obvious  future  route  is  ana¬ 
lyzing  the  effects  of  scaling  and  rotation  transformations  between  images.  Depending 
on  the  environment  in  which  a  laser  imaging  system  is  operated  and  on  the  platform 
on  which  it  is  installed,  significant  gains  could  be  made  by  incorporating  rotation  and 
scaling  compensation  into  the  registration  shift  estimation  algorithm  design. 

5.3.4  Long-range  Scintillation  Noise  Effects.  Yet  another  obvious  avenue 
is  examining  the  atmospheric  turbulence  effects  on  the  long-range  data  that  create 
additional  scintillation  noise  on  top  of  the  speckle  noise.  I11  this  area  LITE  algorithm 
design  robustness  could  be  significantly  advanced  by  incorporating  the  turbulence 
statistics  in  the  estimation  process. 

5.3.5  Pre-Processing  Technique  Analysis.  As  part  of  improving  the  overall 
computational  speed  of  the  algorithm,  there  may  be  analog  pre-processing  techniques 
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which  could  be  implemented  to  accelerate  the  calculations  of  the  LITE  algorithm. 
Specifically,  an  analog  pre-filter  designed  to  perform  the  log  function  of  the  LITE 
algorithm  could  be  implemented  in  the  image  processing  chain  before  the  analog 
signal  passes  into  the  A/D  converters. 

5.3.6  Beam,  Platform,  and  Target  Motion  Effects.  Another  ripe  area  of 
research  within  laser  image  processing  is  to  develop  an  algorithm  or  redesign  the 
LITE  algorithm  to  distinguish  between  beam,  platform,  and  target  motion  that  may 
be  present  in  a  laser  imaging  system.  The  algorithm  would  need  to  quantify  each 
motion  independently  to  allow  for  independent  compensation  techniques  that  would 
prevent  the  registration  algorithm  from  falsely  locking  onto  any  of  these  false  motion 
effects. 
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Appendix  A.  Shift  Parameter  Estimation  Using  Gaussian  Noise 


This  appendix  is  provided  as  additional  background  both  for  the  cross-correlation 
registration  algorithm  and  estimation  theory.  As  part  of  a  background  self- 
study,  an  analysis  was  conducted  using  a  Gaussian  noise  assumption  in  the  shift 
parameter  estimation  theory  as  described  in  Chapter  III. 

The  following  are  the  analytical  calculations  and  their  implications  for  this  re¬ 
search;  they  demonstrate  why  the  cross-correlation  is  the  best  shift  estimator  for  a 
signal  with  white  Gaussian  noise. 

!  NOTE:  In  this  thesis,  the  development  of  the  new  registration  algorithm 
is  limited  in  that  it  considers  only  translational  shifts  (i.e.,  only  those  shifts  in 
the  vertical  and  horizontal  directions).  Hence,  the  shift  estimation  conducted 
in  this  appendix  is  also  limited  to  translational  shifts. 


A.l  Estimation  Theory  Using  the  Gaussian  Noise  Assumption 

In  the  Data  Model  section  in  Chapter  II,  the  observed  images  R\  and  R2  are 
expressed  as 

Ri{x,y)  =  I(x,y)  +  NAx,y),  (A.l) 

R2(x,y)  =  I(x  -  a,y  -  (3)  +  N2(x,y).  (A.2) 

where  the  observations  of  the  Rs  are  the  light  intensity  or  photon  counts  in  each  pixel 
of  the  measure  target  scene. 

The  Parameter  Estimation  Model  for  this  analysis  assumes  that  the  noise  com¬ 
ponents  in  Equations  A.l  and  A.2  are  white  Gaussian;  the  noise  is  distributed  as  a 
normal  distribution  with  zero  mean  and  variance  Nfx,y )  ~  N(0,  a2),  thus  Ni  and 
N2  are 


Ni  = 


\[Pko 


exp 


■(Rj(x,y)  -  I(x,y)f 
2a2 


(A.3) 


From  this  assumption  Equation  A.3  is  used  in  the  probabilistic  mapping  between 
the  parameter  space  and  the  observation,  and  the  PDFs  of  Ri  and  R2  are 
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N  N 


-(R1(xi,y1)-I(x1,y1))2 

2a1 


(A.4) 


-(R2(x2,y2)-I(x2-a’y2-)3))2 


(A.5) 


From  Chapter  III,  the  goal  in  estimation  theory  is  to  use  the  observation  R  to 
estimate  the  true  value  of  the  variable  /  from  the  parameter  space,  based  on  what  is 
known  about  the  probabilistic  mapping  of  I.  The  inverse  mapping  from  observation 
space  back  to  the  parameter  space  is  accomplished  via  the  estimation  rule  [8],  and 
various  estimators  are  used  for  this  rule.  However,  for  this  shift  estimation  problem 
the  maximum  likelihood  estimator  is  selected,  and  is  discussed  next. 

A. 2  Maximum  Likelihood  Estimation 

Before  delving  into  the  derivation  of  the  algorithm,  a  short  description  of  Max¬ 
imum  Likelihood  (ML)  estimation  is  provided.  The  ML  estimator  is  used  as  an 
estimation  rule  for  known  real,  non-random  parameter  estimation  and  is  used  as  one 
type  of  estimation  procedure  that  measures  how  well  the  estimation  performs.  Van 
Trees  describes  the  likelihood  function  as  a  probability  function  pr\i(R\I),  which  is  a 
function  of  /  [8,  page  65].  Since  the  natural  logarithm  is  often  used  in  this  estima¬ 
tion  procedure,  it  is  sometimes  referred  to  as  the  log- likelihood  function  [8].  The  ML 
estimator  Imi(R )  is  defined  as  the  value  of  I  “at  which  the  likelihood  function  is  a 
maximum”  [8,  page  65].  If  the  maximum  value  is  part  of  I's  parameter  space,  then 
the  likelihood  equation  can  be  determined  by  differentiating  lnpr|j(i?|J)  with  respect 
to  I  and  setting  the  result  equal  to  zero. 
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A. 3  Algorithm  Design  Using  the  ML  Estimator  and  Gaussian  Noise 
Assumption 

The  design  for  the  shift  parameter  estimation  begins  with  implementing  the 
Probabilistic  Mapping  from  above  using  the  Gaussian  noise  distribution  assumption 
from  Equations  A. 4  and  A. 5.  Then  a  maximum  likelihood  (ML)  estimator  is  incor¬ 
porated  in  deriving  the  log- likelihood  estimators  for  the  a  and  (5  shifts.  The  design  is 
based  on  using  two  images:  a  baseline  true  image  and  a  secondary,  shifted  true  image 
as  described  by  R\  and  R2  in  Equations  A.l  and  A. 2. 

Consider  first  the  observation  Ri  of  first  image  containing  no  shift  and  the 
assumed  Gaussian  noise.  Then,  from  Equations  A. 4,  the  PDF  for  the  entire  image  is 


N  N 

Pr\{x,y)\i\{x,y)  (Rl  (x,y)  |  A  (D  ?/))  nn 

x=l  y=  1 


v^F. 


-(Rl(x,y)-Ii(x,y))z 


71  (J  r ) 


(A.6) 


Next  a  ML  estimator  Imi  is  derived  for  R  by  first  taking  the  natural  logarithm 
of  Equation  A.6,  then  taking  the  derivative  for  one  discrete  point  (xq,Do)  and  setting 
the  result  equal  to  zero: 


N  N  r 


In  [pri|ji(i?i|Jm;)]  ^  ^ 


In 


x=l  y=  1  L 


(_L 


(Ri(x,y)  -  Imi(x:y)f 

2  <rl 


(A.7) 


<9 In  [Pn|n(#i|7i)]  _  Ri(x,y)  -  Imi(x,y) 


=  0. 


cr~ 


(A.8) 


dlmi(x0,y0) 

Solving  for  I(x o,  yo),  the  ML  estimator  for  a  discrete  point  in  image  one  is  simply 
the  observation  point  of  image  one,  or 


Imi{xo,yo)  Ri(.xo,yoi), 


(A.9) 


50 


and  it  follows  that  for  the  entire  image  the  ML  estimator  is 


Imi(x,y)  =  Ri(x,y).  (A. 10) 

Continuing  with  image  two,  Equation  A.  10  is  substituted  into  Equation  A. 2  to 

yield 

R2{x,  y)  =  imi{x  —  a,y  —  (3)  +  N2(x,  y)  (A. 11) 

Next,  using  Equation  A.  11  in  the  PDF  of  Equation  A. 5  for  the  second  image, 
and  substituting  in  Equation  A.  10  results  in 


N  N 

-(R2(x,y)-Iml(x-<x,y-P))2 

Pr2\aAR2\a,  P)  —  1111  /^—  e 

x=l  y=l  VZ7T(Jn 

N  N 


=  nn 

x=l y— 1 


-(R2(x,y)-R1(x-a,y-p))2 

2^2 


(A. 12) 


Note  that  the  shift  difference  between  the  observed  images  R\  and  R2  is  ac¬ 
counted  for  in  R,\ ,  which  allows  for  the  isolation  of  a  and  (3  in  order  to  solve  for  their 
respective  estimators. 

Next,  to  derive  ML  estimators  for  a  and  [3  a  log-likelihood  is  calculated  by  tak¬ 
ing  the  natural  logarithm  of  Equation  A.  12, 


N  N  r 


In  \pn\a,p(Ik\a,  P)\  =  ^2 

x=l  y= 1 


In  I  — 
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(R2(x,  y)  -  Rj(x  -  a,  y  -  f3)f 


(A.13) 
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Thus  the  log-likelihood  function  is 


N  N 


L(a,0)  =  Y,Y. 


x=l  y=  1  L 


(R2(x,  y)  -  Ri(x  -  a,  y  - 
2  al 


(A.14) 


and  Equation  A.14  can  be  expanded  into 


L(ot,P) 
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(A. 15) 


By  inspection  of  the  terms  in  Equation  A.  15,  it  is  clear  that  the  first  term  is 
not  affected  by  a  and  f3.  Thus,  it  does  not  affect  the  value  of  the  log-likelihood  sum¬ 
mation.  The  third  term  is  affected  by  the  a  and  j3  shifts  only  around  the  edges  of 
the  image.  At  the  edges  pixel  values  could  potentially  vary  significantly  depending 
on  the  intensity  variations  between  images  along  the  edges.  This  could  potentially 
add  or  subtract  significantly  in  the  summation.  However,  to  simplify  the  analysis, 
it  is  assumed  that  the  edge  effects  are  negligible  and  the  third  term  can  be  ignored. 
Hence,  Equation  A.  15  simplifies  to  the  middle  cross-correlation  term,  which  results  in 

^  N  N 

L{a,  P)  =  ~2  ^2  lRz(x’  y)Ri(x  -  a,  y  -  P)\  ■  (A. 16) 

n  x=l  y= 1 

Simply  put,  the  a  and  P  shifts  that  create  a  peak  value  in  the  cross-correlation 
function  are  the  estimators  for  a  and  /? 


52 


argmax 


(A- 17) 


(a,/§)  = 


O,  P) 


L(ct,/3) 


53 


Appendix  B.  Cross- Correlation  vs.  Vector- Block  Performance 

Analysis 


This  appendix  describes  additional  background  research  conducted  on  the  two 
registration  algorithms  in  [5]  that  produced  both  the  fastest  processing  times 
and  the  lowest  error  metric  (MSE):  cross-correlation  and  vector-block.  A  self-study 
analysis  was  conducted  on  these  two  candidates,  where  simulations  were  performed  to 
evaluate  and  compare  their  MSE  and  processing  time  performance  metrics  as  in  [5]. 
This  appendix  outlines  the  methodology  of  the  simulations,  provides  results  from  the 
analysis,  and  considers  conclusions  about  the  mini-study. 

B.l  Methodology 

The  simulation  analysis  for  both  registration  algorithms  is  conducted  using  real- 
world  ground  test  images  generated  by  the  AFRL  Laservision  system.  Images  of  a 
resolution  target  truck  at  3  km  and  a  tank  at  10  km  are  used  to  compare  each  MSE 
performance  for  short  range  and  long  range.  The  algorithms  derived  above  are  im¬ 
plemented  in  Matlab®  for  use  in  the  simulations.  The  next  two  sections  present 
the  results  of  the  images  processed  by  each  algorithm  at  each  range.  Each  section 
presents  a  baseline  image  of  the  scene  as  it  appears  without  registration  or  temporal 
averaging  (highlighting  the  speckle  noise  inherent  to  laser  generated  images),  an  im¬ 
age  of  the  scene  temporal  averaged  from  50  images,  and  an  image  with  registration 
and  temporal  averaging  of  the  50  images.  The  results  of  the  MSE  and  processing 
performance  are  then  presented  at  the  end  of  each  section. 

B.2  Simulation  Results:  3  km  Data 

The  3  km  test  scene  is  of  the  resolution  target  truck,  and  Figure  B.l  illustrates 
the  baseline  scene  and  temporal  averaging  without  registration  using  50  images.  Note 
that  the  averaging  process  suppresses  some  noise,  but  the  lack  of  registration,  or 
aligning  the  images,  causes  severe  blurring.  Figure  B.2  shows  the  visual  improvements 


54 


Figure  B.l:  3  km  Baseline  Scene  and  Temporal  Av¬ 

eraging  without  Registration.  These  images  illustrate  the 

baseline  scene  with  noise  (left  image)  and  temporal  averaging 
without  registration  using  50  baseline  scene  images  (right  im¬ 
age).  The  speckle  noise  is  somewhat  suppressed,  but  there  is 
severe  blurring  due  to  the  lack  of  registration. 


Figure  B.2:  3  km  Cross-correlation  vs.  Vector-Block 

Registration.  Illustrates  the  visual  improvements  of  the  noise 
blurring  for  each  registration  technique,  cross-correlation  on  the 
left  and  vector-block  on  the  right.  Note  there  is  very  little  differ¬ 
ence  seen  with  the  eye.  This  result  is  confirmed  by  the  MSE  com¬ 
parison,  which  shows  a  degradation  in  the  vector-block  method 
of  only  1.36%. 
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Figure  B.3:  3  km  Performance  Metric  Results,  MSE 

and  Processing  Time.  The  MSE  comparison  highlights  a 
degradation  of  only  1.36%  in  the  vector-block  method  versus 
the  cross-correlation  method.  Furthermore,  the  most  significant 
difference  is  that  the  vector-block  method  is  over  two-and-half 
times  faster.  Note:  the  MSE  metric  measurement  is  normalized 
to  one  in  order  to  plot  the  two  metrics  on  the  same  chart. 

of  the  noise  blurring  for  each  registration  technique,  cross-correlation  on  the  left  and 
vector-block  on  the  right. 

Figure  B.2  clearly  demonstrates  there  is  very  little  difference  seen  with  the 
eye.  This  result  is  confirmed  by  the  MSE  comparison  which  shows  a  degradation  in 
the  vector-block  method  by  only  1.36%,  as  depicted  in  Figure  B.3.  However,  most 
striking  is  the  computer  processing  time  required  for  the  vector-block  method  vs.  the 
cross-correlation  method,  which,  based  on  the  P4  3GHz  processor  used,  is  over  two- 
and-a-half  times  faster.  Note:  the  MSE  metric  measurement  is  normalized  to  one  in 
order  to  plot  the  two  metrics  on  the  same  chart. 
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B.3  Simulation  Results:  10  km  Data 


The  10  km  test  scene  is  of  a  tank,  and  Figure  B.4  illustrates  the  baseline  scene 
and  temporal  averaging  without  registration  using  50  images.  Note  that  for  this 
longer  range  image  the  averaging  process  again  suppresses  the  noise,  and  because  the 
noise  is  more  pronounced  at  this  range  the  noise  is  suppressed  enough  to  clear  the 
image  somewhat  even  in  the  absence  of  registration.  Figure  B.5  shows  the  visual 
improvements  of  the  noise  blurring  for  each  registration  technique,  cross-correlation 
on  the  left  and  vector-block  on  the  right.  As  in  the  3  km  test,  Figure  B.5  clearly 
demonstrates  that  there  is  very  little  difference  seen  with  the  eye.  This  result  is 
again  confirmed  by  the  MSE  comparison,  which  shows  a  degradation  in  the  vector- 
block  method  by  only  0.05%,  as  depicted  in  Figure  B.6.  However,  most  striking  once 
again  is  the  computer  processing  time  required  for  the  vector-block  method  vs.  the 
cross-correlation  method,  which  is  still  over  two  times  faster.  Note:  the  MSE  metric 
measurement  is  normalized  to  one  in  order  to  plot  the  two  metrics  on  the  same  chart. 


Figure  B.4:  10  km  Baseline  Scene  and  Temporal  Av¬ 

eraging  without  Registration.  These  images  illustrate  the 

baseline  scene  with  noise  (left  image)  and  temporal  averaging 
without  registration  using  50  baseline  scene  images  (right  im¬ 
age).  Because  the  noise  is  more  pronounced  at  this  range,  the 
averaging  process  suppresses  it  enough  to  clear  the  image  some¬ 
what  even  in  the  absence  of  registration. 
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Figure  B.5:  10  km  Cross-correlation  vs.  Vector-Block 

Registration.  Illustrates  the  visual  improvements  of  noise 
blurring  for  each  registration  technique,  cross-correlation  on  the 
left  and  vector-block  on  the  right.  Note  that  there  is  very  lit¬ 
tle  difference  seen  with  the  eye.  This  result  is  confirmed  by  the 
MSE  comparison,  which  shows  a  degradation  in  the  vector-block 
method  by  only  0.05%. 
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Figure  B.6:  10  km  Performance  Metric  Results,  MSE 

and  Processing  Time.  The  MSE  comparison  highlights  a 
degradation  of  only  0.05%  in  the  vector-block  method  versus 
the  cross-correlation  method.  Furthermore,  the  most  signifi¬ 
cant  difference  is  that  the  vector-block  method  is  over  two  times 
faster.  Note:  the  MSE  metric  measurement  is  normalized  to  one 
in  order  to  plot  the  two  metrics  on  the  same  chart. 
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B.4  Mini-Study  Conclusion 

The  most  obvious  conclusion  drawn  from  this  mini-study  is  the  dramatic  reduc¬ 
tion  in  the  cross-correlation  computational  load  due  to  dimensionality  reduction  of 
the  calculations,  which  results  in  striking  differences  in  processing  times  between  the 
two  algorithms.  Equally  striking  is  how  little  variance  there  is  in  MSE,  which  trans¬ 
lates  into  maintaining  quality  in  the  final  image  product.  Coiipled  with  the  significant 
computer  processing  time  saving,  the  vector-block  method  is  an  attractive  substitute 
for  the  cross-correlation  method.  However,  this  result  does  not  detract  from  potential 
improvement  that  can  be  gained  through  developing  a  registration  algorithm  using 
the  true  noise  effect  distribution  statistics  in  the  shift  estimation  process. 
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Appendix  C.  Computer  Code 


This  appendix  provides  examples  of  the  Mat  lab®  computer  code  developed  for 
both  the  simulated  and  real  comparison  tests  conducted  on  the  LITE  and  Cross¬ 
correlation  algorithms. 


Listing  C.l:  This  first  listing  is  the  Matlab®  code  used  for  preparing  the  simulated 
data.  It  consists  of  using  a  true  image  scene  (i.e.,  a  scene  with  no  noise),  which  is  taken 
from  the  Laservision  data  base  and  generated  through  other  research  efforts.  This 
true  scene  is  replicated  and  each  replicated  scene  is  scaled  to  generated  an  average 
SNR  value  for  the  range  of  SNR  values  simulated  (0.8  -  7). 

(appendix3/listlSNR.m) 


7. 1 1 1 7. 7. 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 

7,  Major  Darren  R.  Sabo 
7.  Fall  2004 

7.  AFIT/ENG  Thesis  Project 

7.  Laser  Image  Registration  Algorithm 

7.  Average  SNR  range  scaling  of  images 

7. 


clear  all ; 
close  all  ; 
clc 

load  M; 
tic  ; 

7. - 

7.  Set  range  of  SNR  values 

7. - 

SNR_vals_l  =  [0 . 2  :  .  2  :  1]  ; 
SNR_vals_2  =  [1 . 2 :  .  2 : 2]  ; 
SNR_vals_3  =  [2 . 2 : . 2 : 3] ; 
SNR_vals_4  =  [3 . 2  :  .  2 : 4]  ; 
SNR_vals_5  =  [4 . 2 :  .  2 : 5]  ; 

N1  =  size (SNR_vals_l  ,2)  ; 
N2  =  size (SNR_vals_2  ,2)  ; 
N3  =  s ize ( SNR_vals_3  ,  2)  ; 
N4  =  size (SNR_vals_4  ,  2)  ; 
N5  =  size (SNR_vals_5  ,2)  ; 


7. - 

7.  Find  mean  roots  for  scaling  images 

7. - 


for  i  =  1 : N1 

Cl  =  [(l-SNR_vals_l (i)/M)  - SNR_ val s_ 1 ( i )  0] ; 


60 


mean_rootsl(:,:,i)  =  roots (Cl); 

end 

40 

[il,jl,vl]  =  find (mean.rootsl) ; 
vl  ; 

45  for  i  =  1 : N2 

C2  =  [(l-SNR_vals_2 (i)/M)  - SNR_ val s_2 ( i )  0] 
mean_roots2(:,:,i)  =  roots(C2); 

end 

50  [i2,j2,v2]  =  find (mean_roots2) ; 
v2  ; 

for  i  =  1 : N3 

55  C3  =  [(l-SNR_vals_3(i)/M)  - SNR_ val s_3 ( i )  0] 

mean_roots3(:,:,i)  =  roots(C3); 

end 

[i3,j3,v3]  =  find (mean_roots3) ; 

60 

v3  ; 

for  i  =  1 : N4 

C4  =  [(l-SNR_vals_4(i)/M)  - SNR_ val s_4 ( i )  0] 
65  mean_roots4(:,:,i)  =  roots(C4); 

end 

[i4,j4,v4]  =  find (mean_roots4) ; 

70  v4  ; 

for  i  =  1 : N5 

C5  =  [(l-SNR_vals_5 (i)/M)  - SNR_ val s_5 ( i )  0] 
mean_roots5(:,:,i)  =  roots(C5); 

75  end 

[i5,j5,v5]  =  find (mean_roots5) ; 
v5  ; 

80 

7. - 

°/0  Create  scaling  variables 

% - 

load  true2_center ; 

85  true_mean  =  mean (mean ( true2_cent er )) ; 

for  i  =  1 : length (vl ) 

scalel(i)  =  vl ( i ) / true.mean ; 

end 
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for  i  =  1 : length ( v2 ) 

scale2(i)  =  v2 (i) /true.mean ; 

end 

for  i  =  1 : length ( v3 ) 

scale3(i)  =  v3 (i) /true.mean ; 

end 

for  i  =  1 : length (v4) 

scale4(i)  =  v4 ( i ) / true.mean ; 

end 

for  i  =  l:length(v5) 

scale5(i)  =  v5 (i) /true.mean ; 

end 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Scale  images  to  vary  SNR  light  intensities 

7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


for 

i  =  1 : length ( vl ) 

end 

true_img_scaledl  (:  , 

:  .  i) 

for 

i  =  1 : length ( v2 ) 

end 

true_img_scaled2  (  :  , 

:  ,  i) 

for 

i  =  1 : length ( v3 ) 

end 

true_img_scaled3  (  :  , 

:  .  i) 

for 

i  =  1 : length ( v4 ) 

end 

true_img_scaled4  (  :  , 

:  .  i) 

for 

i  =  1 : length ( v5 ) 

end 

true_img_scaled5  (  :  , 

:  ,  i) 

scalel(i) . *true2_center ; 


scale2(i) . *true2_center ; 


scale3(i) . *true2_center ; 


scale4(i) . *true2_center ; 


scale5(i) . *true2_center ; 


save (’scale .mat  ’  ,  ’  vl  ’  ,  ’ v2 ’  ,  ’  v3  ’  ,  ’  v4  ’  ,  ’SNR_vals_l ’  ,  .  .  . 

1 SNR_vals_2 ’  ,  ’ SNR_vals_3 ’  ,  ’ SNR_vals_4 ’  ,  .  .  . 

’true_img_scaledl  ’  ,  ’true_img_scaled2  ’  ,  ’true_img_scaled3  ’  ,  .  .  . 
’ true_img_scaled4  ’  ,  ’  v5  ’  ,  ’SNR_vals_5’  ,  ’ true_img_scaled5 1 )  ; 


toe  ; 
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Listing  C.2:  This  next  listing  is  the  Matlab®  code  used  for  processing  the  simu¬ 

lated  data  and  running  the  comparison  test  between  the  LITE  and  Cross-correlation 
algorithms.  The  code  is  documented  well  enough  to  understand  how  the  Monte  Carlo 
simulation  is  executed. 

(appendix3/list2simulated.m) 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 1 1 1 1 1 1 1 7. 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 


7.  Major  Darren  R.  Sabo 
7.  Fall  2004 


7.  AFIT/ENG  Thesis  Project 

7.  Laser  Image  Registration  Algorithm 

7.  Monte  Carlo  Si mul at  ion 

7.  CC  vs.  LITE  algorithm  comparison 

7.  With  varying  SNR  intensity  values 

7.  FILE  #1_1 


7.  Approx,  time  to  run:  11  hrs  w/  20  SNR  values 

7. 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 7. 7. 7. 7. 7. 7. 7. 7. 7.  %  7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 1 7. 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


7.  NOTE:  The  average  SNR  values  (0.8  -  7.0)  and  their  associated 
7.  images  that  were  scaled  to  those  average  values  were  saved  in 
7.  a  separate  .mat  files  and  were  broken  up  into  several  batch 
7.  files  for  separate  processing  in  order  to  run  on  mult  iple  PCs 
7.  to  save  t  ime  . 

1 


7.  This  is  one  example  of  those  batch  files  to  illustrate  how  the 
7.  simulations  were  set  up  and  run. 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


clear  all ; 

close  all  hidden; 

clc 

7«Resets  it  to  a  different  state  each  time, 
r and ( ’ st at e  ’  , sum (100* clock))  ; 

7.  Loads  in  the  specific  SNR  values  for  this  batch  file. 
S  =  load ( 1  scale . mat 1 SNR_vals_l ’)  ; 

SNR_vals_l  =  S . SNR_vals_ 1 ; 
clear  S  ; 

SNR_index  =  [45]; 

SNR_vals_l  =  SNR_vals_ 1 ( SNR_ index ) ; 

N= size ( SNR_vals_ 1  ,2)  ; 
dB  =  10* log  1 0 ( SNR_vals _ 1 )  ; 

N1  =  1000;  7.  Number  of  noise  realizations 
M  =  50  ; 
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R=M  ; 


tic  ; 

for  a  =  1:N  "/«  SNR  value  loop. 

7.  Loads  in  the  true  image  cube 
S  =  load (’ scale . mat  1  true_img_scaledl  1 )  ; 

V.  Pulls  out  only  the  image  associated  with  the  SNR  value. 
true_img_scaledl  =  S.true_img_scaledl (: , : , SNR.index (a) ) ; 

clear  S ; 

rows  =  size (true_img_scaled , 1) ; 
cols  =  size ( true_img_scaled  ,  2)  ; 

for  i  =  1:N1  Noise  realization  loop. 

true_tank_cubel  =  repmat (true_img_scaledl +1 , [1  1  2]); 

N2  =  size (true_tank_cubel  ,3)  ; 

for  b  =  1  :  N2  7.  Loop  to  individually  select  each  image  and 
’/,  add  random,  independent  negative  binomial 
7.  noise  . 

K_barl  =  true_tank_cubel ( :  ,  :  , b)  ; 


7. 

% 

l 

1 


Use  Matlab  nbinrnd  to  generate  negative 
distributed  random  numbers. 


binomial 


PI  =  (M . / (M  +  K_bar 1 ) )  ; 

RND_negbin_noise  =  nbinrnd (R , PI  ,  500 , 500)  ; 
tank_sim_wnoise_cubel ( : , : , b)  =  RND_negbin_no i se + 1 ; 

clear  RND_negbin_noise ; 
clear  K_bar 1 ; 
clear  PI  ; 

rand ( ’ state ’  , sum (100* clock))  ; 

end 


7.  figure  ; 

7«  image  sc  (tank_sim_wnoise_cubel  (  :  ,  :  ,  1)  ) 

/  colormap ( gray ) ; 

clear  true_tank_cubel ; 


7o - 

7.  Register  with  LITE  algorithm 
7o - 
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G 1 _ 1  (  :  ,  : )  =  log (tank_sim_wnoise_cubel ( :  ,  :  ,  1) )  ; 

7.  The  log  of  a  ratio  is  the  difference  the  logs  of  the 
7.  numerator  and  denominator  can  be  computed  separately. 
G2_l  =  log (t ank_s im_wno i se_ cube 1(:  ,  1 ) +M)  ; 

Gl_l=conj (f f t2 (Gl_l ) ) ; 

G2_l=conj (f f t2 (G2_l ) ) ; 

for  k  =  2 : N2 

temp  =  fft2 (tank_sim_wnoise_cubel (: , : ,k) ) ; 

7,  This  is  the  term  produced  by  the  numerator 
Crossl_LITEl  =  r eal ( if f t 2 ( t emp . * G 1 _ 1 ) ) ; 

7.  This  is  the  term  produced  by  the  denominator 
Cross2_LITEl  =  real ( if ft2 (temp .* G2_ 1 )) ; 

FCross_LITEl  =  f ft  shift ( Cro ss 1 _LITE1 - Cro ss2_LITE 1 )  ; 

clear  Crossl_LITEl ; 
clear  Cross2_LITEl ; 
clear  G 1 _ 1 ; 
clear  G2_l ; 

7,  Find  the  maximum  PSD  point  to  determine 
7,  registration  shift: 

[rowmax , colmax]  =  f ind ( FCross_LITEl ==max (max . . . 
(FCross_LITEl)  )  )  ; 

clear  FCross_LITEl ; 

shiftrow  =  rowmax -251; 
shifted  =  colmax-251; 
dx_LITEl  (k-l)=- shifted; 
dy_LITEl (k-1) =- shiftrow ; 


end 

dx_LITE_vecl_l  (i)  =  dx_LITEl ; 
dy_LITE_vecl_l (i)  =  dy_LITEl ; 


7. - 

7o  Register  with  CC  algorithm 

7. - 


Baseline.ccl  =  repmat (t ank_s im_wno i se_ cube 1(:  ,1) 

[1  1  N2]  )  ; 

for  m  =  2 : N2 

Cross.ccl  =  real(ifft2(fft2(Baseline_ccl (:  , :  ,m))  .  .  . 
,*conj  (fft2(tank_s im_wno i se_  cube l(:,:,m))))); 
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FCross_ccl  =  f f t shift ( Cr os s_c c 1 ) ; 


clear  Cross.ccl ; 

7.  Find  the  maximum  PSD  point  to  determine 
1  registration  shift: 

[rowmax , colmax]  =  f ind ( FCr os s_cc 1 == . . . 

max(max(FCross_ccl))) ; 
shiftrow  =  rowmax -251; 
shifted  =  colmax-251; 
dx_ccl (m-l)=shiftcol ; 
dy_ccl (m-l)=shiftrow; 

clear  FCross.ccl ; 


end 

dx_cc_ ve c 1 _ 1 ( i )  =  dx_ccl; 
dy_ cc_ ve c 1 _ 1 ( i )  =  dy_ccl; 

clear  t ank_ s im_wno i se.cube 1 ; 
clear  Baseline_ccl ; 


end 

sigma_LITEl_l (a  ,  : )  =  N ~ -0 . 5* sqrt ( ( sum ( dx_LITE_ve c 1 _ 1  .  ~ 2 ) )  .  .  . 

+  ( sum ( dy_LITE_ ve c 1 _ 1  .  ~ 2) ) )  ; 

sigma_ccl_l (a ,  : )  =  N " -0 . 5* sqrt ( ( sum ( dx_c c_ vec 1 _ 1  .  ~ 2 ) )  .  .  . 

+  ( sum ( dy_ cc_ve c 1 _ 1 . “ 2) ) ) ; 


toe  ; 


end 
toe  ; 

sigma_LITEl_l 

sigma_ccl_l 

f igur e  ; 

plot ( SNR_vals_ 1  , sigma_LITEl_l  ,SNR_vals_l  , sigma_ccl_l  ) 
xlabel ( ’ SNR ’ )  ; 

y label (’ \ s igma_ { reg}  (pixels)1); 
legend (’LITE’  ,  ’ Cross-Corr  '  )  ; 

save ( ’ compare 1_3_1000  .mat  ’  ,  ’ s igma_LITEl _ 1  ‘  ,  ’ s igma.ee 1 _ 1  1  ,  .  .  . 
’dx_LITE_vecl_l  ’  ,  ’dy_LITE_vecl_l  1  ,  ’ dx_cc_vecl_l  ’  ,  .  .  . 
’dy_cc_vecl_l  1  ,  ’ rowmax  ’  ,  ’ colmax  ’  )  ; 
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Listing  C.3:  This  listing  is  the  Matlab®  code  used  for  processing  the  real  data  and 
running  the  comparison  test  between  the  LITE  and  Cross-correlation  algorithms.  The 
code  is  documented  well  enough  to  understand  how  the  algorithms  are  tested. 
(appendix3/list3real.m) 


•/  •/  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

/o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o 


7. 

70  Major  Darren  R.  Sabo 

7.  Winter  2005 

7.  AFIT/ENG  Thesis  Project 

7.  Laser  Image  Registration  Algorithm 

7. 

7.  Real  data  comparison  LITE  vs.  CC 
7.  Standard  Deviation  Metric 

7. 


7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

/o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  / 0  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o  /o 


clear  all ; 
close  all ; 
clc 

load  M; 


7. 7. 7. 7. 7. 7. 7. 7. 7, 7, 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  7.  7.  7. 7. 7. 7. 7. 7. 7. 7.  7.  7. 7. 7. 7. 


7. 


7.  Load  &  view  real  resolution  target  data  with  speckle  noise. 

7. - 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  7. 7. 1 7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  %  7. 7. 


load  restgt_data_cube ; 
N1  =  size (data.cube  ,  1) 
N2  =  size (data.cube  ,2) 
N3  =  size (data.cube  ,3) 


7  500 
7  500 

7.  50  images 


7«  Find  the  middle  row  and  column  values  of  image  for  use  in  the 
7,  algorithms  . 
rows  =  1 : N 1  ; 

mid.row  =  r ound ( medi an ( rows ) ) ; 
cols  =  1 : N2  ; 

mid_col  =  round (median ( cols )) ; 


7.  figure  ; 

7o  image  sc  (data_cube  (  :  ,  :  ,  1)  ) 

7.  colormap  (gray  ) 

7c  set(gca,’FontSize’,ll); 

7c  title(’Real  data  w/  Speckle  Noise’); 
7c  7c  ax  is  off; 


7. - 

7c  Register  with  LITE  algorithm 
7c - 
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7. 7. 7. 7. 7. 7. 7. 7. 7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

7  Calculate  the  LITE  registration  algorithm: 

7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 


restgt_LITE  =  zeros (N1 , N2 , N3 )  ;  7  Initializes  the  resolution 

7  target  registration  algorithm 
7  processing . 

restgt_LITE(:,:,l)=data_cube(:,:,l);  7  Sets  first  image  in  the 

7  restgt_LITE  cube  equal  to 
7  the  first  image  of  the 
7  data  cube  file. 

G1 ( : , : )  =  log(data_cube(:,:,l)+.001);  7  The  log  of  a  ratio  is  the 

7  difference  of  their  logs 
7  so  the  logs  of  the 
7  numerator  and  denominator 
7  can  be  computed  separately 


G2=log(data_cube(: , : ,1)+M) ; 

Gl=conj (f ft2 (Gl) ) ; 

G2  =  con j  (f ft2 (G2) )  ; 

tic  ; 

for  i  =  2 : N3 

t emp  =  f  f 1 2 (data.cube ( :  ,  :  ,i))  ; 

7  This  is  the  term  produced  by  the  numerator 
Crossl  =  real ( if ft2 (temp .* (Gl ))) ; 

7  This  is  the  term  produced  by  the  denominator 
Cross2  =  real ( if ft2 (temp .* (G2) )) ; 

FCross  =  f f t shift ( Cross  1 )  ; 

7  Find  the  maximum  PSD  point  to  determine  registration  shift: 
[rowmax , colmax]  =  f ind ( FCross ==max (max ( FCr os s ))) ; 
shiftrow  =  rowmax -mid_row ;  7  finds  row  shift  value 
shifted  =  colmax -mid_col ;  7  finds  column  shift  value 
dx_LITE(i)=-shiftcol ; 
dy_LITE (i) =-shiftrow ; 

restgt_LITE(:,:,i)  =  makeshift(data_cube(:,:,i),... 

dx_LITE ( i ) , dy_LITE ( i ) ) ;  7  makeshift  is  a  separate 

7  Matlab  routine  that  shifts  each 
7  image  in  the  cube  by  their 
7  respective  row  &  column  shifts 
7  estimated  by  the  algorithm.  The 
7  makeshift  code  is  included  in 
7  this  Appendix . 

end 
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LITE_TIME 


toe  ; 


100 

clear  Crossl  Cross2  FCross  G1  G2 ; 


7 - 

%  Register  with  CC  algorithm 
105  7„ - 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Replicate  image  1  from  image  data  cube  to  create  baseline  image 
7.  for  registration 

110  7. 7. 7. 7. 7. 7. 7. 7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

Baseline.cc  =  data.cube 


Base_fft2  =  f f t 2 ( Basel ine.ee ) ; 
115  clear  Baseline.cc ; 


tic  ; 

for  m  =  1 : N3 

Cross.cc  =  real ( if f t2 (Base.f f t2 . * . . . 
120  conj(fft2( data.cube (:,:,m))))); 

FCross.cc  =  f f tshif t (Cross.cc ) ; 


7  Find  the  maximum  PSD  point  to  determine  registration  shift: 
[rowmax , colmax]  =  f ind ( FCr o ss _c c ==max (max ( FCr os s_ cc  )  )  )  ; 

125  shiftrow  =  rowmax -mid.row ;  7  finds  row  shift  value 

shifted  =  colmax -mid.col ;  7  finds  column  shift  value 
dx.ee (m) =shiftcol ; 
dy_cc (m) =shiftrow ; 


130  restgt.cc.reg  ( :  ,  :  ,m)  = 

dx.ee (m) ,dy_cc(m)) ; 


135 


end 


makeshift (data.cube ( :  , :  , m)  ,  .  .  . 

7  makeshift  is  a  separate 
7  Mat lab  routine  that  shifts  each 
7  image  in  the  cube  by  their 
7  respective  row  &  column  shifts 
7  estimated  by  the  algorithm.  The 
7  makeshift  code  is  included  in 
7  this  Appendix. 


140  CC_TIME  =  toe ; 


7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

7  Temporal  average  unregistered  images: 

7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

145  Temp.ave.unreg  =  mean ( data.cube  ,  3)  ; 


7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

7  Temporal  average  registered  images: 

150  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 
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Temp_ave_cc  =  mean (restgt_cc_reg  ,  3)  ; 
Temp_ave_LITE  =  mean (restgt_LITE  ,  3)  ; 


clear  Crossl  Cross2  Cross.cc  FCross  FCross.cc  G1  G2 ; 

155 


7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 1 7 1 7 1 7 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7 7 7 7 7 7 7 7 7 7. 7 7 7 7 7 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Display  shifts  and  algorithm  times 

7. 7. 7. 7. 7. 7. 7. 7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7. 7  7. 7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7. 7  7  7  7  7  7  7  7. 7  7. 7  7  7  7  7  7 


dy_LITE ; 
160  dy_cc  ; 

dx_LITE  ; 
dx_cc  ; 
LITE_TIME  ; 
CC_TIME  ; 

165 


7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

7  Standard  Deviation  Comparison 

7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 


170  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

7  Calculate  Standard  Deviation  for  LITE 

7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 


I_LITE  =  Temp_ave_LITE ; 

175 

stdev_LITE=0 ; 
for  k  =  1 : N3 

stdev_LITE  =  stdev_LITE  +  sum ( sum ( ( restgt_LITE ( : , : ,k)  . . 

I _L ITE  (  :  ,  : ) )  .~2))/(Nl*N2*N3); 

180  end 


clear  I_LITE  ; 

stdev_LITE  =  sqrt ( stdev_LITE ) 

185 


190 


7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 
7  Calculate  Standard  Deviation  for  CC 

7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

I_CC  =  Temp_ave_cc; 


stdev_CC  =0 ; 
for  k  =  1 : N3 

195  stdev_CC  =  stdev_CC  +  sum ( sum ((restgt_cc_reg(: , : ,k)  . . 

I_CC  (  :  ,  : ) )  . ~2) ) /(N1*N2*N3) ; 

end 


clear  restgt_cc_reg  I_CC; 

200 

stdev_CC  =  sqrt ( stdev_CC ) 
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7. 1 1 1 1 1 1 1 1 1 1 1 7. 1 7. 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

205  7.  Calculate  &  Display  Average  SNR  of  scene 

7. 1 1 1 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

Ave_data_cube  =  mean(mean(data_cube(:,:,l))) 


Ave_SNR_data_cube  =  Ave_data_cube / stdev_LITE 


210 


save(’Real_compare_021805.mat’  ,  ’ dy_LITE ’  ,  ’ dx_LITE  ’  ,  .  .  . 

1 LITE_TIME ’  ,  ’ dy_cc ’  ,  ’ dx.cc ’  ,  ’ CC_TIME ’  ,  ’ Ave_SNR_data_cube ’  ,  .  .  . 
’ stdev_LITE ’ , 1 stdev_CC ’ ) ; 

215 


7.  / 1 1 1 7. 7. 7. 1 7. 1 1 1 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 
7.  Plot  images 

7. 7. 7. 7. 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 7. 7. 7. 7. 7. 7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 


220  f igur e  ; 

subplot (221) 

imagesc (data.cube ( :  ,1)) 

colormap (gray) 

set (gca ,  ’FontSize’  ,11)  ; 

225  title ( [ ’ Real  Scene  ,  Ave  SNR  =  ’  ,  .  .  . 

num2str (Ave_SNR_data_cube , ’ %3 . 2f ’ ) ] ) ; 


subplot (222 ) 

imagesc ( Temp_ave_unr eg )  ; 

230  colormap ( gray ) ; 
axis  off  ; 

set (gca  ,  ’FontSize’  ,11)  ; 

title ([ ’ Temp .  Ave.  Unreg.,  #  Images  =  ’,  num2str (N3) ] ) ; 

235  subplot (223) 

imagesc ( Temp_ave_LITE ) ; 
colormap ( gray ) ; 
axis  off  ; 

set (gca  ,  ’FontSize’  ,11)  ; 

240  title  ([’LITE,  \sigma  =  ’,  num2str  (stdev_LITE,  ’  7«3 . 2f  ’  )  ]  )  ; 

subplot  (224) 
imagesc (Temp_ave_cc ) ; 
colormap (gray) ; 

245  axis  off  ; 

set (gca  ,  ’FontSize’  ,11)  ; 
title ( [ ’Cross-Correlation  ,  \sigma  = 
num2str  (stdev_CC  ,  ’  7,3 . 2f  ’  )  ]  )  ; 


250  clear  Temp_ave_LITE  Temp_ave_cc  Temp_ave_unreg ; 

7. 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  Ill  z  0  0  M 1  START  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

/.  =  =========  =  =  =  =  =  =  =  =  =  =  ===  ====  =  =  =  =  =  =  =  ======== 

/.  =  =========  =  =  =  =  =  =  =  =  ========  =  =  =  =  =  =  =  =  ======== 
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255  7 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 
7.  Zoom  on  image  to  find  lower  SNR  average  scene 

7. 7. 7. 7. 7. 7. 7. 7. 7. 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 


rowl_zl 
row2_z 1 
260  c  o 1 1 _  z 1 
col2_z 1 


143; 

rowl_zl +41 ; 
201  ; 

coll_zl +41 ; 


img.zooml 


restgt_LITE(rowl_zl :row2_zl  , coll_zl  : col2_zl  ,1)  ; 


265  mean_img_zooml  =  mean ( restgt_LITE  .  .  . 

(rowl_zl : row2_zl  , col 1 _z 1 : col2_zl  ,  : )  ,3)  ; 


Nlz 

N2z 


270 


size (mean_img_zooml  ,1)  ; 
size (mean_img_zooml  ,2)  ; 


7. 7. 7. 7. 7 7 7 7 7 7 7 7 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7.  7  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Calculate  &  Display  Average  SNR  of  zoom  scene 

7. 7. 7. 7. 7. 7. 7. 7. 7  7. 7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7. 7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 


totimg_zooml  =  zeros (Nlz , N2z) ; 

275 


mean_ave_zooml  =  mean (mean (mean_img_zooml )) ; 


for  i  =  1 : N3 

totimg_zooml  =  t ot img.zooml  +  ( r e st gt _LITE  .  .  . 

280  (rowl_zl:row2_zl  ,coll_zl:col2_zl  ,i)-mean_img_zooml)  .  ~ 2 ; 

end 


stdev.zooml  =  sqrt ( sum ( sum ( t ot img.zooml ) ) / ( N3 *N2z * Nlz ) ) ; 
285  SNR_avg_zooml  =  mean_ave_zooml / stdev_zooml 


7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  z  0  0  M  l  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

7  View  zoom  scene 

7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 


290 

7  figure  ; 

7  imagesc (img.zooml) 
7  colormap (gray ) 

7  ax  is  of  f  ; 

295 


7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  z  0  0  M  l  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

7  Create  zoom  data  cube: 

7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

300  data_cube_zooml  =  data_cube (rowl_zl : row2_zl  , coll_zl : col2_zl  ,  : )  ; 


Nlz  =  size (data_cube_zooml , 1) 
N2z  =  size (data_cube_zooml , 2) 
N3z  =  size (data_cube_zooml , 3) 

305 

rows_zoom  =  l:Nlz; 


72 


mid_row_zoom  =  round (median (rows_zoom) ) ; 
cols_zoom  =  1 : N2z ; 

mid_col_zoom  =  round (median ( cols.zoom)  )  ; 

310 

/.  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  = 
/.  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  = 
7.  Compare  zoom  scene 

%======================================= 

315  %======================================= 


7. 


7.  Register  with  LITE  algorithm 

7. - 

320 


7. 1 1 1 1 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  z  0  0  M  l  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7,  Calculate  the  LITE  registration  algorithm: 

7. 7. 7. 7. 7. 7. 7. 7 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 


325  restgt_LITE_zooml  =  zeros (Nlz , N2z , N3z) ; 

restgt_LITE_zooml (:  ,  :  ,l)=data_cube_zooml (:  ,  :  ,1)  ; 

Gl(:,:)  =  log(data_cube_zooml(:,:,l)+.001); 

7,  The  log  of  a  ratio  is  the  difference  of  their  logs  so 
330  7.  the  logs  of  the  numerator  and  denominator  can  be 

7,  computed  separately 

G2  =  log(data_cube_zooml (:  ,  :  ,1)+M)  ; 

Gl=conj (f ft2 (Gl) ) ; 

335  G2  =  con j  (f ft2 (G2) )  ; 


tic  ; 

for  i  =  2 : N3z 

7.i; 

340  7o  pause  (  .  1 ) 

t  emp  =  f  f 1 2 (data_cube_zooml (:  ,  :  ,i))  ; 

7,  This  is  the  term  produced  by  the  numerator 
Crossl  =  r eal ( if f t 2 ( t emp . * ( Gl ) ) ) ; 

345 

7,  This  is  the  term  produced  by  the  denominator 
Cross2  =  real ( if ft2 (temp .* (G2) )) ; 

FCross  =  f f t shift ( Cross  1  - Cross2 )  ; 

350 

7,  Find  the  maximum  PSD  point  to  determine  registration  shift: 
[rowmax , colmax]  =  f ind ( FCross ==max (max ( FCr os s ))) ; 
shiftrow  =  rowmax -mid_row_zoom ; 
shifted  =  colmax -mid_col_zoom  ; 

355  dx_LITE_zooml (i) =-shif tcol ; 

dy_LITE_zooml (i)=-shiftrow ; 


restgt_LITE_zooml  (  :  , :  , i)  =  makeshift (data_cube_zooml  .  .  . 


73 


360  end 


(: , : ,i) ,dx_LITE_zooml (i) ,dy_LITE_zooml (i)) ; 


LITE_zooml_TIME  =  toe; 


365  7 - 

7  Register  with  CC  algorithm 

7. - 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


Z00M1 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


370 


7.  Replicate  image  1  from  image  data  cube  to  create  baseline  image 
7.  for  registration 


7. 7 7 7 7 7 7 7 7 7 7 7 7 7 7 1 1 1 1 7 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7 7 7 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


Baseline_CC_zooml  =  data_cube_zooml 


375  Base_fft2  =  f f t2 (Baseline_CC_zooml )  ; 


tic  ; 

for  m  =  1 : N3z 

Cross.cc  =  real (if ft2 (Base_f f t2  .  * .  .  . 

380  conj (fft2(data_cube_zooml (: , : , m) ) ) ) ) ; 

FCross.cc  =  f f tshif t (Cross.cc ) ; 

7.  Find  the  maximum  PSD  point  to  determine  registration  shift: 
385  [rowmax , colmax]  =  f ind ( FCr o ss _c c ==max (max ( FCr os s_ cc ) ) ) ; 

shiftrow  =  rowmax -mid.r ow.zoom ; 
shifted  =  colmax-mid.col.zoom  ; 
dx_CC_zooml (m)=shiftcol ; 
dy_CC_zooml (m)= shiftrow ; 

390 

restgt.CC.zooml _reg ( : , : , m)  =  makeshift (data.cube.zooml . . . 

(:  ,  m)  , dx.CC.zooml (m)  ,dy_CC_zooml(m))  ; 

end 


395  CC_zooml_TIME  =  toe; 


%  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  z  0  0  M  l  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Temporal  average  unregistered  images: 

7. 7. 7. 7. 7. 7. 7. 7. 7  7. 7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

400  Temp.ave.unreg.zooml  =  mean ( data.cube.zooml ,3) ; 


7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  z  0  0  M  l  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7  7 

7  Temporal  average  registered  images: 

405  7  7 7 7 7 7 7 7 7 7 7 7 7  7  7  7  7  7  7  7 7 7 7 7 7 7 7 7 7  7  7  7  7 7 7 7 7 7 7 7 7 7 7 7 7 7  7  7  7  7  7 7 7 7 7 7  7  7  7  7 7 7 7 7 7 

Temp.ave.CC.zooml  =  mean (restgt.CC.zooml.reg  ,  3)  ; 
Temp.ave.LITE.zooml  =  mean (restgt.LITE.zooml  ,3)  ; 


clear  Crossl  Cross2  Cross.cc  FCross  FCross.cc  G1  G2 ; 


410 
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7. 7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  z  0  0  M  l  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Display  shifts  and  algorithm  times 

7. 1 1 1 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 7. 7. 1 1 1 1 7. 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 
415  dy_LITE_zooml  ; 
dy_CC_zooml ; 
dx_LITE_zooml  ; 
dx_CC_zooml ; 

LITE_zooml_TIME 
420  CC_zooml_TIME 

7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  z  0  0  M  l  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Standard  Deviation  Comparison 

7. 7. 1 1 1 1 1 1 1 1 1 1 1 7. 1 1 1 1 1 1 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7. 1 1 1 

425 

7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  z  0  0  M  l  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Calculate  Standard  Deviation  for  LITE 

7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

430  I_LITE_zooml  =  Temp_ave_LITE_zooml  ; 


435 


stdev_LITE_zooml=0; 
for  k  =  1 : N3z 

stdev_LITE_zooml  =  stdev_LITE_zooml  ... 

+  sum ( sum ( ( restgt_LITE_zooml  (  :  ,  :  , k)  ... 

-  I_LITE_zooml ~2) ) / ( Nlz * N2z * N3z ) ; 

end 


stdev_LITE_zooml  =  sqrt ( stdev_LITE_zooml ) 


440 


445 


7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  z  0  0  M  l  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  Calculate  Standard  Deviation  for  CC 

/  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  /  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

I_CC_zooml  =  Temp_ave_CC_zooml ; 


stdev_CC_zooml=0; 
for  k  =  1 : N3z 

450  stdev_CC_zooml  =  stdev_CC_zooml  .  .  . 

+  sum ( sum ( ( restgt_CC_zooml_reg ( : , : ,k) 

-  I_CC_zooml(: ,:)) ,~2))/(Nlz*N2z*N3z); 

end 

455  stdev_CC_zooml  =  sqrt ( stdev_CC_zooml ) 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  z  0  0  M  l  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

460  7,  Plot  images 

7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  %  7. 7. 7. 7. 7. 7. 

f igur e  ; 
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subplot  (221) 

imagesc (data_cube_zooml ( :  ,  :  ,1)) 

465  colormap ( gray ) 

set (gca ,  ’FontSize’  ,11)  ; 

title ( [ ’ Zoomed  Scene  ,  Ave  SNR  =  ’  ,  ... 

num2str  (SNR_avg_zooml  ,  ’  7,3 . 2f  ’  )  ]  )  ; 

470  subplot (222) 

imagesc ( Temp _ ave _unreg_zooml ) ; 
colormap (gray) ; 
axis  off  ; 

set (gca  ,  ’FontSize’  ,11)  ; 

475  title ([’ Temp .  Ave.  Unreg.,  #  Images  =  ’,  num2str (N3) ] ) ; 
subplot (223) 

imagesc (Temp_ave_LITE_zooml)  ; 
colormap ( gray ) ; 

480  axis  of f  ; 

set (gca ,  ’FontSize’  ,11)  ; 
title(’Temp.  Ave.  LITE  Reg.’); 

title  ([’ LITE  ,  \sigma  =  ’,  num2str  (  stdev_LITE_zooml  ,  ’  °/03 . 2f  ’  )  ]  )  ; 

485  subplot (224) 

imagesc (Temp_ave_CC_zooml )  ; 
colormap ( gray ) ; 
axis  off  ; 

set (gca,  ’FontSize’  ,11)  ; 

490  title ( [ ’Cross-Correlation  ,  \sigma  =  ’,  ... 

num2str (stdev_CC_zooml , ’  7.3 . 2f  ’  )  ]  ) ; 

save ( ’Real_compare_zooml_021905 .mat ’  ,  ’dy_LITE_zooml ’  ,  .  .  . 

’ dx_LITE_zooml ’  ,  ’ LITE_zooml_TIME ’  ,  ’ dy_CC_zooml ’  ,  .  .  . 

495  ’dx_CC_zooml  ’  ,  ’CC_zooml_TIME’  ,  ’SNR_avg_zooml  ’  ,  .  .  . 

’ stdev_LITE_zooml  ’  ,  ’ stdev_CC_zooml  ’  )  ; 


7. 7.  %  7. 7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7.  z  o  o  M  2  start  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

500  •/,  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  = 

/.  =  =========  =  =  =  =  =  =  =  =  =========  =  =  =  =  =  =  =  =  ======= 

7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 

7.  NOTE:  THIS  ZOOM-IN  PROCESS  WAS  REPEATED  FOR  OTHER  SUB-REGIONS 

7.  OF  THE  LARGER  SCENE  TO  FIND  OTHER  LOWER  AVERAGE  SNR  AREAS  TO 
505  7.  TEST  THE  TWO  ALGORITHMS  AGAINST. 

7. 

7.  A  TOTAL  OF  4  SMALLER  REGIONS  WAS  FOUND  WITH  AVERAGE  SNRs  BETWEEN 
7.  4.17  AND  5.15. 

7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 
510  %========================================== 

/.  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  = 


7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 
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515  y,  A  total  of  the  range  values  and  the  standard  deviations  is 
7.  compiled  to  plot. 

7.  y.  y.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


SNR_range  =  [ SNR_avg_zoom3  SNR_avg_zoom4  SNR_avg_zoom2 
520  SNR_avg_zooml  Ave_SNR_data_cube] 

Stdev_LITE_rg  =  [ stdev_LITE_zoom3  stdev_LITE_zoom4  ... 
stdev_LITE_zoom2  stdev_LITE_zooml  stdev_LITE] 


525  Stdev_CC_rg  =  [ stdev_CC_zoom3  stdev_CC_zoom4  stdev_CC_zoom2 . . . 
stdev_CC_zooml  stdev_CC] 


f igur e  ; 

plot(SNR_range  ,  Stdev_LITE_rg,  ’-o’  ,  ’LineWidth’  ,1.5,  ’ MarkerSize  ’  ,5) 
530  hold  on  ; 

plot(SNR_range  ,Stdev_CC_rg  ,  ’  :xr'  ,  ’LineWidth’  ,1.5,  ’MarkerSize’  ,7) 

7«axis  tight  ; 

set (gca ,  ’FontSize’  ,11)  ; 

xlabel ( ’ SNR  ’  )  ; 

535  y label (’ \ s igma_ { i }  (pixel  intensity)’); 
legend(’LITE’ , ’ Cross-Corr ’ ) ; 


7.  y.  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


540 


7.  A  very  simple  processing  time  calculation  analysis  is  done 
7.  using  the  tic/toc  commands  seen  above  to  provide  an  estimated 
7.  percentage  difference  between  the  two  algorithms. 


7.  y.  y.  7. 7. 7. 7. 7. 7. 1 1 1 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 1 1 1 1 1 1 1 1 1 1 7. 7. 7. 7. 7. 7.  %  7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 7. 


Perc.improve.full  =  100* ( 1 -LITE_TIME/ CC_TIME) 

545 

LITE_ztimes_ave  =  mean ( [ LITE_zoom3_TIME  LITE_zoom4_TIME  ... 
LITE_zoom2_TIME  LITE_zooml_TIME]) 

CC_ztimes_ave  =  mean ( [CC_zoom3_TIME  CC_zoom4_TIME  ... 

550  CC_zoom2_TIME  CC_zooml_TIME] ) 

Perc_improve_zoom  =  1 00* ( 1  - LITE_zt ime s_ave / CC_zt ime s_ave ) 

save(’Real_compare_total_022005.mat’  ,  ’SNR_range’  ,  .  .  . 

555  ’Stdev_LITE_rg’  ,  ’Stdev_CC_rg’  ,  ’ Perc.improve.full  ’  ,  .  .  . 

’LITE_ztimes_ave  ’  ,  ’CC_ztimes_ave  ’  ,  ’Perc_improve_zoom’)  ; 
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Listing  C.4:  This  final  listing  is  the  Matlab®  code  for  the  simple  shift  registration 
routine  provided  for  this  research  effort.  The  code  is  documented  well  enough  to 
understand  how  it  functions. 

(appendix3/list4makeshift.m) 

function  [img2]=  makeshif t ( imgl , dx , dy) 

7.  function  [img2]=  makeshif  t  (  imgl  ,  dx  ,  dy) 

7.  dy  and  dx  are  the  shifts  in  the  vertical  and  horizontal 
“/,  directions  respectively  imgl  and  img2  are  the  two  images 
5  "/«  from  a  sequence  of  video  delta  is  the  denominator  of  the 
7,  fraction  of  a  pixel  to  which  the  estimation  is  to  be  done. 

y. 

7.  Ex  1/10  pixel  estimation  means  delta  =10 

10  sz  =  size ( imgl )  ; 
sz=max(max(sz)) ; 
center  =  [ f loor ( sz / ( 2 ) ) + 1] ; 

linx  =  -  cent  er  + 1  :  1  :  cent er -2  ; 
linx  =  -2*pi*linx/sz ; 

15  linx  =  f f t shift ( 1 inx )  ; 

liny  =  linx  ’  ; 

px  =  cos  (  1  inx  *  dx  )  +  sqrt  (  - 1 )  *  s  in  ( 1  inx  *  dx  )  ; 
py  =  cos  ( 1  iny  *  dy  )  +  sqrt  (  - 1 )  *  s  in  ( 1  iny  *  dy  )  ; 

20  img2  =  real ( if ft2 (fft2 ( imgl ).* (py*px) )) ; 
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